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Preface 


In Linux Shell Scripting Bootcamp, you will begin by learning the essentials of script 
creation. You will learn how to validate parameters and also how to check for the 
existence of files. Moving on, you will get well-versed with how variables work on 

a Linux system and how they relate to scripts. You'll also learn how to create and 
call subroutines and create interactive scripts. Finally, you will learn how to debug 
scripts and scripting best practices, which will enable you to write a great code every 
time! By the end of the book you will be able to write shell scripts that can dig data 
from the Web and process it efficiently. 


What this book covers 


Chapter 1, Getting Started with Shell Scripting, begins with the basics of script design. 
How to make a script executable is shown as is creating an informative Usage 
message. The importance of return codes is also covered with the use and validation 
of parameters. 


Chapter 2, Working with Variables, discusses how to declare and use both environment 
and local variables. We also speak about how math is performed and how to work 
with arrays. 


Chapter 3, Using Loops and the sleep Command, introduces the use of loops to perform 
iterative operations. It also shows how to create a delay ina script. The reader will 
also learn how to use loops and the sleep command in a script. 


Chapter 4, Creating and Calling Subroutines, starts with some very simple scripts and 
then proceeds to cover some simple subroutines that take parameters. 


Chapter 5, Creating Interactive Scripts, explains the use of the read built-in command 
to query the keyboard. Further, we explore some of the different options to read and 
also cover the use of traps. 
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Chapter 6, Automating Tasks with Scripts, describes the creation of scripts to automate 
a task. The proper way to use cron to run a script automatically at a specific time 

is covered. The archive commands zip and tar are also discussed for performing 
compressed backups. 


Chapter 7, Working with Files, introduces the use of the redirection operator for 
writing out a file and use of read command for reading a file. Checksums and file 
encryption are also discussed, and a way to convert the contents of a file into a 
variable is also covered. 


Chapter 8, Working with wget and curl, discusses the usage of wget and cur] in scripts. 
Along with this, return codes are also discussed with a couple of example scripts. 


Chapter 9, Debugging Scripts, explains some techniques to prevent common syntax 
and logic errors. A way to send output from a script to another terminal using the 
redirection operator was also discussed. 


Chapter 10, Scripting Best Practices, discusses some practices and techniques that will 
help the reader create good code every time. 


What you need for this book 


Any Linux machine that has Bash should be able to run these scripts. This includes 
desktops, laptops, embedded devices, BeagleBone, and so on. Windows machines 
running Cygwin or some other emulated Linux environment will also work. 


There are no minimum memory requirements. 


Who this book is for 


This book is for both GNU/Linux users who want to do amazing things with the 
shell and for advanced users looking for ways to make their lives with the shell 
more productive 


Conventions 


In this book, you will find a number of text styles that distinguish between different 
kinds of information. Here are some examples of these styles and an explanation of 
their meaning. 
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Code words in text, database table names, folder names, filenames, file extensions, 
pathnames, dummy URLs, user input, and Twitter handles are shown as follows: 
You can see that the echo statement Start of x loop was displayed A block of 
code is set as follows: 


echo "Start of x loop" 
x=0 
while [ $x -lt 5 ] 
do 
echo "x: Sx" 
let x++ 


Any command-line input or output is written as follows: 


guestl $ ps auxw | grep script7 


New terms and important words are shown in bold. Words that you see on the 
screen, for example, in menus or dialog boxes, appear in the text like this: "Clicking 
the Next button moves you to the next screen." 





Warnings or important notes appear in a box like this. | 


[ Qh Tips and tricks appear like this. | 


Reader feedback 


Feedback from our readers is always welcome. Let us know what you think about 
this book — what you liked or disliked. Reader feedback is important for us as it helps 
us develop titles that you will really get the most out of. 


To send us general feedback, simply e-mail feedbackepacktpub.com, and mention 
the book's title in the subject of your message. 


If there is a topic that you have expertise in and you are interested in either writing 
or contributing to a book, see our author guide at www. packtpub.com/authors. 
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Customer support 


Now that you are the proud owner of a Packt book, we have a number of things to 
help you to get the most from your purchase. 





Downloading the example code 


You can download the example code files for this book from your account at 

http: //www.packtpub.com. If you purchased this book elsewhere, you can visit 
http: //www.packtpub.com/support and register to have the files e-mailed directly 
to you. 


You can download the code files by following these steps: 


Log in or register to our website using your e-mail address and password. 
Hover the mouse pointer on the SUPPORT tab at the top. 

Click on Code Downloads & Errata. 

Enter the name of the book in the Search box. 

Select the book for which you're looking to download the code files. 
Choose from the drop-down menu where you purchased this book from. 
Click on Code Download. 


ND 7 PF WON 


You can also download the code files by clicking on the Code Files button on the 
book's webpage at the Packt Publishing website. This page can be accessed by 
entering the book's name in the Search box. Please note that you need to be logged in 
to your Packt account. 


Once the file is downloaded, please make sure that you unzip or extract the folder 
using the latest version of: 

¢ WinRAR / 7-Zip for Windows 

* Zipeg / iZip / UnRarX for Mac 

° 7-Zip / PeaZip for Linux 
The code bundle for the book is also hosted on GitHub at https: //github.com/ 
Packt Publishing/Linux-Shell-Scripting-Bootcamp. We also have other code 


bundles from our rich catalog of books and videos available at https: //github. 
com/Packt Publishing/. Check them out! 
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Errata 


Although we have taken every care to ensure the accuracy of our content, mistakes 
do happen. If you find a mistake in one of our books — maybe a mistake in the text or 
the code—we would be grateful if you could report this to us. By doing so, you can 
save other readers from frustration and help us improve subsequent versions of this 
book. If you find any errata, please report them by visiting http: //www.packtpub. 
com/submit-errata, selecting your book, clicking on the Errata Submission Form 
link, and entering the details of your errata. Once your errata are verified, your 
submission will be accepted and the errata will be uploaded to our website or added 
to any list of existing errata under the Errata section of that title. 


To view the previously submitted errata, go to https: //www.packtpub.com/books/ 
content /support and enter the name of the book in the search field. The required 
information will appear under the Errata section. 


Piracy 


Piracy of copyrighted material on the Internet is an ongoing problem across all 
media. At Packt, we take the protection of our copyright and licenses very seriously. 
If you come across any illegal copies of our works in any form on the Internet, please 
provide us with the location address or website name immediately so that we can 
pursue a remedy. 


Please contact us at copyright@packtpub.com with a link to the suspected 
pirated material. 


We appreciate your help in protecting our authors and our ability to bring you 
valuable content. 


Questions 


If you have a problem with any aspect of this book, you can contact us at 
questions@packtpub.com, and we will do our best to address the problem. 
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Getting Started with 
Shell Scripting 


This chapter is a brief introduction to shell scripting. It will assume the reader is 
mostly familiar with script basics and will serve as a refresher. 


The topics covered in this chapter are as follows: 


The general format of a script. 

How to make a file executable. 

Creating a good Usage message and handling return codes. 

Show how to pass parameters from the command line. 

Show how to validate parameters by using conditional statements. 


Explain how to determine the attributes of files. 


Getting started 


You will always be able to create these scripts under a guest account, and most 
will run from there. It will be clearly stated when root access is needed to run a 
particular script. 


The book will assume that the user has put a (.) at the beginning of the path for that 
account. If not, to run a script prepend . / to the filename. For example: 


$s ./runme 


The scripts will be made executable using the chmod command. 
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It is suggested that the user create a directory under his guest account specifically for 
the examples in this book. For example, something like this works well: 


§ /home/guest1/LinuxScriptingBook/chapters/chap1 
Of course, feel free to use whatever works best for you. 


Following the general format of a bash script the very first line will contain this and 
nothing else: 


#!/bin/sh 
Note that in every other case text following the # sign is treated as comments. 
For example, 


# This entire line is a comment 


chmod 755 filename # This text after the # is a comment 


Use comments however you deem appropriate. Some people comment every line, 
some don't comment anything. I try to strike a balance somewhere in the middle of 
those two extremes. 


Using a good text editor 


I have found that most people are comfortable using vi to create and edit text 
documents under a UNIX/Linux environment. This is fine as vi is a very dependable 
application. I would suggest not using any type of word processing program, even if 
it claims to have a code development option. These programs might still put invisible 
control characters in the file which will probably cause the script to fail. This can take 
hours or even days to figure out unless you are good at looking at binary files. 


Also, in my opinion, if you plan to do a lot of script and/or code development I 
suggest looking at some other text editor other than vi. You will almost certainly 
become more productive. 


Demonstrating the use of scripts 


Here is an example of a very simple script. It might not look like much but this is the 
basis for every script: 
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Chapter 1 - Script 1 
#!/bin/sh 

# 

# 03/27/2017 

# 


exit 0 


. By convention, in this book the script lines will usually be 
GA numbered. This is for teaching purposes only, in an actual 
script the lines are not numbered. 


Here is the same script with the lines numbered: 


1 #!/bin/sh 

2 # 

3. # 03/27/2017 
4 # 

5 exit 0 

6 


Here is an explanation for each line: 
* Line 1 tells the operating system which shell interpreter to use. Note that on 
some distributions /bin/sh is actually a symbolic link to the interpreter. 


¢ Lines that begin with a # are comments. Also, anything after a # is also 
treated as a comment. 


¢ It is good practice to include a date in your scripts, either here in the 
comments section and/or in the Usage section (covered next). 


¢ Line 5 is the return code from this script. This is optional but highly 
recommended. 


¢ Line 6 is a blank line and is the last line of the script. 


Using your favorite text editor, edit a new file named script1 and copy the 
preceding script without the line numbers into it. Save the file. 


To make the file into an executable script run this: 


$ chmod 755 scriptl 
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Now run the script: 


$ scriptl 


If you did not prepend a . to your path as mentioned in the introduction then run: 


§ ./scriptl 


Now check the return code: 


$ echo $? 


0 


Here is a script that does something a little more useful: 


Chapter 1 - Script 2 


#!/bin/sh 


# 


# 3/26/2017 


# 


ping -c 1 google.com # ping google.com just 1 time 


echo Return code: $? 


The ping command returns a zero on success and non-zero on failure. As you can 
see, echoing $? shows the return value of the command preceding it. More on 
this later. 


Now let's pass a parameter and include a Usage statement: 


Chapter 1 - Script 3 


© OY WD UV KR WHY HB 


BR 
jo) 


#!/bin/sh 

# 

# 6/13/2017 

# 

if [ S# -ne 1] ; then 

echo "Usage: script3 file" 

echo " Will determine if the file exists." 
exit 255 

fi 
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11 
12 
13 
14 
15 
16 
7 
18 


if [ -£ $1] ; then 

echo File $1 exists. 

exit 0 

else 

echo File $1 does not exist. 
exit 1 


fi 


Here is an explanation for each line: 


Line 5 checks to see if a parameter was given. If not, lines 6 through 9 are 
executed. Note that is it usually a good idea to include an informative Usage 
statement in your script. It is also good to provide a meaningful return code. 


Line 11 checks to see if the file exists and if so lines 12-13 are executed. 
Otherwise lines 14-17 are run. 


A word about return codes: It is standard practice under Linux/UNIX to 
return zero if the command was successful, and non-zero if not. In this way 
the code returned can mean something useful, not only to humans, but to 
other scripts and programs as well. However, it is not mandatory to do this. 
If you want your script to return codes that are not errors but indicate some 
other condition by all means do so. 


This next script expands on this topic: 


Chapter 1 - Script 4 


al 
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#!/bin/sh 

# 

# 6/13/2017 

# 

if [ S# -ne 1] ; then 

echo "Usage: script4 filename" 


echo " Will show various attributes of the file given." 


exit 255 
fi 
echo -n "$1 " # Stay on the line 
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13 if [— ! -e $1 ] ; then 

14 echo does not exist. 

15 exit 1 # Leave script now 
16 fi 

17 


18 if [ -£ $1] ; then 


19 echo is a file. 


20 elif [ -d $1] ; then 
21 echo is a directory. 
22 fi 

23 


24 if [ -x $1 ] ; then 


25 echo Is executable. 
26 fi 
25] 


28 if [ -r $1] ; then 
29 echo Is readable. 
30 else 

31: echo Is not readable. 
32+. fa. 

33 

34 if [ -w $1 ] ; then 
35 echo Is writable. 
36 6fi 

37 

38 if [ -s $1] ; then 
39 echo Is not empty. 


40 else 

41 echo Is empty. 

42 fi 

43 

44 exit 0 # No error 
45 
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Here is an explanation for each line: 


¢ Lines 5-9: If the script is not run with a parameter display the Usage message 
and exit with a return code of 255. 


e Line 11 shows how to echo a string of text but still stay on the line 
(no linefeed). 
¢ Line 13 shows how to determine if the parameter given is an existing file. 


¢ Line 15 leaves the script as there is no reason to continue if the file 
doesn't exist. 


The meaning of the remaining lines can be determined by the script itself. Note that 
there are many other checks that can be performed on a file, these are just a few. 


Here are some examples of running script4 on my system: 


guestl $ script4 
Usage: script4 filename 


Will show various attributes of the file given. 


guestl $ script4 /tmp 
/tmp is a directory. 
Is executable. 

Is readable. 

Is writable. 


Is not empty. 


guestl $ script4 script4.numbered 
script4.numbered is a file. 
Is readable. 


Is not empty. 


guestl $ script4 /usr 
/usr is a directory. 
Is executable. 

Is readable. 


Is not empty. 


guestl1 $ script4 emptyl 
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emptyl is a file. 
Is readable. 
Is writable. 


Is empty. 


guestl $ script4 empty-noread 
empty-noread is a file. 

Is not readable. 

Is empty. 


This next script shows how to determine the number of parameters that were passed 
to it: 


Chapter 1 - Script 5 
#!/bin/sh 

# 

# 3/27/2017 

# 

echo The number of parameters is: S# 


exit 0 


Let's try a few examples: 


guestl $ script5 


The number of parameters is: 0 


guestl $ script5 parml 


The number of parameters is: 1 


guestl $ script5 parml1 Hello 


The number of parameters is: 2 


guestl $ script5 parml Hello 15 


The number of parameters is: 3 


guestl $ script5 parml Hello 15 "A string" 
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The number of parameters is: 4 


guestl1 $ script5 parml Hello 15 "A string" lastone 
The number of parameters is: 5 


1 
Q Remember that a quoted string is counted as 1 parameter. 


This is a way to pass strings that contain blank characters. 


This next script shows how to handle multiple parameters in more detail: 


Chapter 1 - Script 6 
aaa 

# 3/27/2017 

# 


if [ S# -ne 3 ] ; then 
echo "Usage: script6 parml parm2 parm3" 


echo " Please enter 3 parameters." 


exit 255 
fi 


echo Parameter 1: $1 
echo Parameter 2: $2 


echo Parameter 3: $3 


exit 0 


The lines of this script were not numbered as it is rather simple. The $# contains the 
number of parameters that were passed to the script. 
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Summary 


In this chapter we looked at the basics of script design. How to make a script 
executable was shown as was creating an informative Usage message. The importance 
of return codes was also covered as was the use and validation of parameters. 





The next chapter will go into more detail about variables and conditional statements. 








[10] 


Working with Variables 


This chapter will show how variables are used in a Linux system and in scripts. 
The topics covered in this chapter are: 


¢ Using variables in scripts 
¢ Validating parameters using conditional statements 
¢ Comparison operators for strings 


e Environment variables 


Using variables in scripts 


A variable is simply a placeholder for some value. The value can change; however, 
the variable name will always be the same. Here is a simple example: 


a=1 

This assigns the value 1 to variable a. Here's another one: 
b=2 

To display what a variable contains use the echo statement: 


echo Variable a is: Sa 


ae Notice the $ preceding the variable name. This is required in order 
y-~ to show the contents of the variable. 


If at anytime, you aren't seeing the results you expect first check for the $. 
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Here's an example using the command line: 


a=1 


echo a 
echo Sa 


$ 
$ 
a 
$ 
1 
$ b="Jim" 

$ echo b 

b 

$ echo Sb 

Jim 

All variables in a Bash script are considered to be strings. This is different than in 


a programming language such as C, where everything is strongly typed. In the 
preceding example, a and b are strings even though they appear to be integers. 


Here's a short script to get us started: 


Chapter 2 - Script 1 
oa 

# 6/13/2017 

# 


echo "scripti" 


# Variables 


a="1" 

b=2 
c="Jim" 
d="Lewis" 


e="Jim Lewis" 


pi=3.141592 


# Statements 
echo Sa 
echo $b 


echo $c 
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echo $d 
echo Se 
echo Spi 
echo "End of script1" 


And here is the output when run on my system: 











guesti@big1:~/LinuxScriptingBook/chapters/chap2 


File Edit View Search Terminal Help 


guestl ~/LinuxScriptingBook/chapters/chap2 $ scriptl 
scriptl - Linux Scripting Book 

1 

2 

Jim 

Lewis 

Jim Lewis 

3.141592 

End of scriptl 

guestl ~/LinuxScriptingBook/chapters/chap2 $ [] 





Since all of the variables are strings I could have also done this: 


a=" 1" 
b=a"Q" 
It is important to quote strings when they contain blank spaces such as variables d 


and e here. 


j I have found if I quote all the strings in my programs, but not the 
numbers, it is easier to keep track of how | am using the variable 
4 (that is, as a string or a number). 


Validating parameters using conditional 
statements 


Variables can be tested and compared against other variables when using a variable 
as a number. 


Here is a list of some of the operators that can be used: 


f-eq This stands for equal to 
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This stands for not equal to 
This stands for greater than 


This stands for greater than or equal to 
This stands for less than or equal to 
This stands for the negation operator 


Let's take a look at this in our next example script: 





This stands for less than 


Chapter 2 - Script 2 
ea 

# 6/13/2017 

# 


echo "script2" 


# Numeric variables 
a=100 
b=100 
c=200 
d=300 


echo a=Sa b=Sb c=Sc d=$Sd # display the values 


# Conditional tests 
if [ $a -eq $b ] ; then 
echo a equals b 


fa: 


if [ Sa -ne $b ] ; then 


echo a does not equal b 
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if [ $a -gt $c ] ; then 
echo a is greater than c 


fi 


if [ Sa -lt $c ] ; then 
echo a is less than c 


fi 


if [ $a -ge $d] ; then 
echo a is greater than or equal to d 


fi 


if [ $a -le $d ] ; then 
echo a is less than or equal tod 


fi 


echo Showing the negation operator: 
if [ ! $a -eq $b ] ; then 

echo Clause 1 

else 

echo Clause 2 

fi 


echo "End of script2" 


And the output is as follows: 











guesti@big1:~/LinuxScriptingBook/chapters/chap2 
File Edit View Search Terminal Help 
guestl ~/LinuxScriptingBook/chapters/chap2 $ script2 
script2 - Linux Scripting Book 
a=100 b=100 c=200 d=300 
a equals b 
a is less than c 


a is less than or equal to d 

Showing the negation operator: 

Clause 2 

End of script2 

guestl ~/LinuxScriptingBook/chapters/chap2 $ [] 
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To help understand this chapter run the script on your system. Try changing the 
values of the variables to see how it affects the output. 


We saw the negation operator in Chapter 1, Getting Started with Shell Scripting when 
we were looking at files. As a reminder, it negates the expression. You could also say 
it does the opposite of what the original statement means. 


Consider the following example: 


a=1 
b=1 
if [ $a -eq $b ] ; then 
echo Clause 1 
else 
echo Clause 2 
fi 
When this script is run it will display Clause 1. Now consider this: 
a=1 
b=1 
if [ ! $a -eq $b ] ; then # negation 
echo Clause 1 
else 


echo Clause 2 


fa: 


Because of the negation operator it will now display Clause 2. Try it on your system. 


Comparison operators for strings 


The comparison for strings are different than for numbers. Here is a partial list: 


Explanation 
fe This stands for equal to 


fi= This stands for not equal to 
This stands for greater than 
This stands for less than 
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Now let's take a look at Script 3: 


Chapter 2 - Script 3 


od FW VU BR WHY HB 


10 
11 
12 
13 
14 
15 
16 
17 
18 
19 
20 
21 
22 
23 
24 
25 
26 
27 
28 
29 
30 
31. 


#!/bin/sh 

# 

# 6/13/2017 
# 


echo "script3" 


# String variables 
strl="Kirk" 
str2="Kirk" 
str3="Spock" 
str3="Dr. McCoy" 
str4="Engineer Scott" 
str5="A" 


str6é="B" 


echo stri=Sstrl str2=Sstr2 str3=Sstr3 str4=Sstr4 


if [ "Sstri" = "Sstr2" ] ; then 
echo strl equals str2 

else 

echo strl1 does not equal str2 


fi 


if [ "Sstri" != "S$str2" ] ; then 
echo str1l does not equal str2 
else 

echo strl1l equals str2 


fi 


if [ "Sstri" = "Sstr3" ] ; then 


echo strl equals str3 
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32 else 


33 echo str1l does not equal str3 


34 fi 
35 
36 if [ "Sstr3" = "Sstr4" ] ; then 


37 echo str3 equals str4 
38 else 


39 echo str3 does not equal str4 





40 fi 

41 

42 echo str5=Sstr5 str6=Sstr6é 

43 

44 if [ "Sstr5" \> "Sstr6é" ] ; then # must escape the > 
45 echo str5 is greater than str6 

46 else 

47 echo str5 is not greater than str6é 

48 fi 

49 

50 if [[ "Sstr5" > "Sstr6é" J] ; then # or use double brackets 
51 echo str5 is greater than str6 

52 else 

53 echo str5 is not greater than str6é 

54 fi 

55 

56 if [[ "Sstr5" < "Sstr6é" J] ; then # double brackets 
57 echo str5 is less than stré6 

58 else 

59 echo str5 is not less than str6 

60 fi 

61 

62 if [ -n "Sstri" ] ; then # test if strl is not null 
63 echo str1 is not null 

64 fi 

65 

66 if [ -z "Sstr7" ] ; then # test if str7 is null 
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67 echo str7 is null 

68 fi 

69 echo "End of script3" 
70 


Here's the output from my system: 











guesti@bigi:~/LinuxScriptingBook/chapters/chap2 
File Edit View Search Terminal Help 


guestl ~/LinuxScriptingBook/chapters/chap2 $ script3 
script3 - Linux Scripting Book 

strl=Kirk str2=Kirk str3=Dr. McCoy str4=Engineer Scott 
strl equals str2 

strl equals str2 

strl does not equal str3 

str3 does not equal str4 


str5=A str6=B 

str5 is not greater than str6 

str5 is not greater than str6 

str5 is less than str6 

str1l is not null 

str7 is null 

End of script3 

guestl ~/LinuxScriptingBook/chapters/chap2 $ [] 





Lets go through this line by line: 


¢ Lines 7-14 set up the variables 

* Line 16 displays their values 

¢ Line 18 checks for equality 

¢ Line 24 uses the not equal operator 

¢ The lines up to 50 are self-explanatory 


¢ Line 44 needs some clarification. In order to avoid a syntax error the > and 
< operators must be escaped 


¢ That is accomplished by using the backslash (or escape) \ character 


¢ Line 50 shows how double brackets can be used to handle the greater than 
operator. As you can see in line 58 it works for the less than operator as well. 
My preference will be to use double brackets when needed. 


¢ Line 62 shows how to check to see if a string is not null. 


¢ And Line 66 shows how to check to see if a string is null. 
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Take a look at this script carefully to make sure it is clear to you. Also notice that 
str7 is shown to be nu11, but we didn't actually declare a str7. That is okay to do in 
a script, it will not generate an error. However, as a general rule of programming it is 
a good idea to declare all variables before they are used. Your code will be easier to 
understand and debug by you and others. 


A scenario that comes up often in programming is when there are multiple 
conditions to test. For example, if something is true and something else is true take 
this action. This is accomplished by using the logical operators. 


Here is Script 4 to show how logical operators are used: 


Chapter 2 - Script 4 
oo 

# 5/1/2017 

# 


echo "script4 - Linux Scripting Book" 


if [| S# -ne 4 ] ; then 
echo "Usage: script4 numberl number2 number3 number4" 


echo " Please enter 4 numbers." 


exit 255 
fi 


echo Parameters: $1 $2 $3 $4 


echo Showing logical AND 

if [[ $1 -eq $2 && $3 -eq $4 ]] ; then # logical AND 
echo Clause 1 

else 

echo Clause 2 


fa: 


echo Showing logical OR 
if [[ $1 -eq $2 || $3 -eq $4 ]] ; then # logical OR 
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echo Clause 1 
else 
echo Clause 2 


£4. 


echo "End of script4" 


exit 0 


Here's the output on my system: 











guesti@big1:~/LinuxScriptingBook/chapters/chap2 
File Edit View Search Terminal Help 


guestl ~/LinuxScriptingBook/chapters/chap2 $ script4 
script4 - Linux Scripting Book 
Usage: script4 numberl number2 number3 number4 
Please enter 4 numbers. 
guestl ~/LinuxScriptingBook/chapters/chap2 $ script4 1111 
script4 - Linux Scripting Book 
Parameters: 1111 
Showing logical AND 
Clause 1 
Showing logical OR 
Clause 1 
End of script4 
guestl ~/LinuxScriptingBook/chapters/chap2 $ script4 11 2 2 
script4 - Linux Scripting Book 
Parameters: 11 2 2 
Showing logical AND 
Clause 1 
Showing logical OR 
Clause 1 
End of script4 
guestl ~/LinuxScriptingBook/chapters/chap2 $ script4 11 2 3 
script4 - Linux Scripting Book 
Parameters: 11 2 3 
Showing logical AND 
Clause 2 
Showing logical OR 
Clause 1 
End of script4 
guestl ~/LinuxScriptingBook/chapters/chap2 $ script4 12 3 4 
script4 - Linux Scripting Book 
Parameters: 123 4 
Showing logical AND 
Clause 2 
Showing logical OR 
Clause 2 
End of script4 
guestl ~/LinuxScriptingBook/chapters/chap2 $ [] 
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Run this script on your system using several different parameters. On each attempt, 
try to determine what the output will be and then run it. Do this as many times as it 
takes until you can get it right every time. Understanding this concept now will be 
very helpful as we get into more complicated scripts later. 


Now let's look Script 5 to see how math can be performed: 


Chapter 2 - Script 5 
hag 

# 5/1/2017 

# 


echo "sScript5 - Linux Scripting Book" 


numl=1 
num2=2 
num3=0 
num4=0 


sum=0 


echo numl1=Snuml 


echo num2=Snum2 


let sum=numl+num2 


echo "The sum is: $sum" 


let numl1++ 


echo "numl is now: Snumi" 


let num2-- 


echo "num2 is now: Snum2" 


let num3=5 


echo num3=Snum3 


let num3=num3+10 
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echo "num3 is now: Snum3" 


let num3+=10 


echo "num3 is now: Snum3" 


let num4=50 


echo "num4=Snum4" 


let num4-=10 


echo "num4 is now: Snum4" 


echo "End of script5" 


And here is the output: 











guesti@bigi:~/LinuxScriptingBook/chapters/chap2 
File Edit View Search Terminal Help 


guestl ~/LinuxScriptingBook/chapters/chap2 $ script5 
- Linux Scripting Book 


is: 3 
now: 
now: 


2 
1 


now: 15 
now: 25 


num4 is now: 40 
End of script5 
guestl ~/LinuxScriptingBook/chapters/chap2 $ [] 





As you can see, the variables are set up as before. The let command is used to 
perform math. Note the $ prefix is not used: 


let sum=numl+num2 


Also note the shorthand way of doing some operations. For example, say you want 
to increment the var num1 by 1. You could do this as follows: 


let numl=numl1+1 
Alternatively, you could use the shorthand notation: 


let numl1++ 
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Run this script and change some of the values to get a feel for how the math 
operations work. We will go over this in much more detail in a later chapter. 


Environment variables 


So far we have only talked about variables that are local to a script. There are also 
system wide environment variables (env vars) which play a very important part of 
any Linux system. Here are a few, some of which the reader may already be aware of: 






































Variable Role 

HOME user's home directory 

PATH directories which are searched for commands 

PS1 command line prompt 

HOSTNAME hostname of the machine 

SHELL shell that is being used 

USER user of this session 

EDITOR text editor to use for crontab and other programs 

HISTSIZE number of commands that will be shown by the history command 
TERM type of command line terminal that is being used 





Most of these are self-explanatory, however, I will mention a few. 


The PS1 environment variable controls what the shell prompt displays as part of the 
command line. The default setting is usually something like [guestl@big1 ~]§, 
which is not as useful as it could be. Ata minimum, a good prompt shows at least 
the hostname and current directory. 


For example, as I work on this chapter the prompt on my system looks just like this: 
big1 ~/LinuxScriptingBook/chapters/chap2 $ 


big1 is the hostname of my system and ~/LinuxScript ingBook/chapters/chap2 is 
the current directory. Recall that the tilde ~ stands for the user's home directory; so in 
my case this expands out to: 


/home/guest1/LinuxScriptingBook/chapters/chap2 
The "$" means I am running under a guest account. 
To enable this, my PS1 env var is defined in /home/guest1/.bashrc as follows: 


export PS1="\h \w $ " 
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The "\h" shows the hostname and the \w shows the current directory. This is a very 
useful prompt and I have been using it for many years. Here's how to show the 
username as well: 


export PS1="\u \h \w § " 
The prompt would now look like this: 
guestl1 bigl ~/LinuxScriptingBook/chapters/chap2 §$ 


If you change the Ps1 variable in your .bashrc file, make certain you do it after any 
other lines that are already in the file. 


For example, here is what my original .bashre contains under my guest1 account: 


# .bashre 


# Source global definitions 

if [ -£ /etc/bashre ]; then 
. /etc/bashre 

fi 


# User specific aliases and functions 


Put your Ps1 definition after these lines. 


If you log into a lot of different machines on a daily basis, there is a 
PS1 trick I have found that is very useful. This will be shown ina 


later chapter. 
y= You may have noticed that it looks as though I did not always use 
a good PS1 variable for the examples in this book. It was edited out 
during book creation to save space. 


The EDITOR variable can be very useful. This tells the system which text editor to use 
for things such as editing the user's crontab (crontab -e). If not set, it defaults to 
the vi editor. It can be changed by putting it in the user's .bashrc file. Here is what 
mine looks like for the root account: 


export EDITOR=/lewis/bin6é4/kw 


When I run crontab -1 (or -e), my personally written text editor comes up instead 
of vi. Very handy! 
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Here we'll take a look at Script 6, that shows some of the variables on my system 
under my guest1 account: 


Chapter 2 - Script 6 
oe 

# 5/1/2017 

# 


echo "Script6é - Linux Scripting Book" 


echo HOME - SHOME 

echo PATH - SPATH 

echo HOSTNAME - SHOSTNAME 
echo SHELL - S$SHELL 

echo USER - SUSER 

echo EDITOR - SEDITOR 
echo HISTSIZE - SHISTSIZE 
echo TERM - STERM 


echo "End of script6" 


Here's the output: 


guesti@bigi:~/LinuxScriptingBook/chapters/chap2 
File Edit View Search Terminal Help 


guestl ~/LinuxScriptingBook/chapters/chap2 $ script6 

script6 - Linux Scripting Book 

HOME - /home/guestl 

PATH - .:/usr/lib64/qt-3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr 
/sbin:/sbin:/home/guest1/bin 

HOSTNAME - bigl.com 


SHELL - /bin/bash 

USER - guestl 

EDITOR - /home/guest1/bin/kw 

HISTSIZE - 5000 

TERM - xterm 

End of script6 

guestl ~/LinuxScriptingBook/chapters/chap2 $ [] 
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You can also create and use your own env vars. This is a really powerful feature of a 
Linux system. Here are some examples that I use in my /root/.bashrc file: 
BIN=/lewis/bin64 

DOWN=/home/guest1/Downloads 

DESK=/home/guest1/Desktop 
JAVAPATH=/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.99.x86_ 64/include/ 
KW_WORKDIR=/root 

L1l=guest1@192.168.1.21 

L4=guest1@192.168.1.2 





LBCUR=/home/guest1/LinuxScriptingBook/chapters/chap2 
export BIN DOWN DESK JAVAPATH KW _WORKDIR L1 L4 LBCUR 


¢ BIN: This is the directory of my executables and scripts under root 
* DOWN: This is the download directory for email attachments, etc 
* DESK: This is the download directory for screenshots 
* JAVAPATH: This is the directory to use when I am writing Java apps 
* KW _WORKDIR: This is where my editor puts its working files 
* 11 and 12: This is the IP addresses to my laptops 
* LBcuR: This is the current directory Iam working in for this book 
Be sure to export your variables so that they can be accessed by other terminals. Also 


remember to source your .bashrc when you make a change. On my system the 
command would be: 


guest1 § . /home/guest1/.bashrec 


sl 


Q Don't forget the period at the beginning of the command! 


I will show in a later chapter how these env vars can be paired with aliases. For 
example, the bin command on my system is an alias that changes the current 
directory to the /lewis/bineé4 directory. This is one of the most powerful features in 
a Linux system, however, I am always surprised that I do not see it used more often. 
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The last type of variable we will cover in this chapter is called an array. Suppose you 
want to write a script that contains all of the IP addresses of the machines in your 
lab. You could do something like this: 





LO=192.168.1.1 

L1=192.168.1.10 
L2=192.168.1.15 
L3=192.168.1.16 
L4=192.168.1.20 
L5=192.168.1.26 


That will work and in fact I do something similar to that in my home office/lab. 
However, suppose you have a whole lot of machines. Using arrays can make your 
life a lot simpler. 


Take a look at Script 7: 


Chapter 2 - Script 7 
oo 

# 5/1/2017 

# 


echo "script7 - Linux Scripting Book" 


array_var=(1 2 3 4 5 6) 


echo ${array_var [0] } 
echo ${array_var[1] } 
echo ${array var [2]} 
echo ${array_ var [3] } 
echo ${array_ var [4] } 
echo ${array_var [5] } 





echo "List all elements:" 


echo ${array_var[*]} 


echo "List all elements (alternative method) :" 
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echo ${array var [@] } 


echo "Number of elements: ${#array_var[*]}" 


labip[0]="192.168.1.1" 


labip [1] ="192.168.1.10" 


labip[2]="192.168.1 
labip[3]="192.168.1.16" 
labip [4] ="192.168.1 


echo 
echo 
echo 
echo 


echo 


echo 


echo 


echo 


echo 


iS" 
-20" 


labip [ol] } 
labip[1]} 
labip[21} 
labip[3]} 
labip [4] } 


"List all elements:" 
${labip[*] } 


"Number of elements: ${#labip[*] }" 
"End of script7" 


And here is the output on my system: 





guesti@big1:~/LinuxScriptingBook/chapters/chap2 
File Edit View Search Terminal Help 


guestl ~/LinuxScriptingBook/chapters/chap2 $ script7 
script7 - Linux Scripting Book 
1 


List all elements: 
123456 
List all elements (alternative method): 


123456 

Number of elements: 6 
192.168.1.1 
192.168.1.10 
192.168.1.15 
192.168.1.16 
192.168.1.20 

List all elements: 
192.168.1.1 192.168.1.10 192.168.1.15 192.168.1.16 192.168.1.20 
Number of elements: 5 

End of script7 

guestl ~/LinuxScriptingBook/chapters/chap2 $ 
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Run this script on your system and try experimenting with it. If you have never seen 
or used an array before, don't let them scare you; you will get familiar with them 
soon enough. This is another area where it's easy to forget the ${ array variable 
here } syntax so if the script doesn't do what you want (or generates an error) 
check that first. 


We will talk about arrays again in much more detail when we cover loops in the 
next chapter. 


Summary 


In this chapter we covered how to declare and use both environment and local 
variables. We talked about how math is performed and how to work with arrays. 


We also covered using variables in scripts. Script 1 showed how to assign a variable 
and display its value. Script 2 showed how to deal with numeric variables and Script 
3 showed how to compare strings. Script 4 showed logical operators and Script 5 
showed how math can be performed. Script 6 showed how environment variables 
are used and Script 7 showed how to use arrays. 
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the sleep Command 


This chapter shows how to use loops to perform iterative operations. It also shows 
how to create a delay in a script. The reader will learn how to use loops and the sleep 
command in a script. 


Topics covered in this chapter are as follows: 


¢ Standard for, while, and until loops. 
* Nesting of loops, and how not to get confused. 
¢ Introduce the sleep command and how it is used to cause a delay in a script. 


* Go over a common pitfall of using sleep. 


Using loops 

One of the most important features of any programming language is the ability to 
perform a task, or tasks, a number of times and then stop when an ending condition 
is met. This is accomplished by using a loop. 


The next section shows an example of a very simple while loop: 


Chapter 3 - Script 1 
anes 

# 5/2/2017 

# 


echo "Sscriptl - Linux Scripting Book" 
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x=1 
while [ $x -le 10 ] 
do 

echo x: $x 

let x++ 


done 
echo "End of script1" 


exit 0 


And here is the output: 














guesti@bigi:~/LinuxScriptingBook/chapters/chaps 
File Edit View Search Terminal Help 


guestl ~/LinuxScriptingBook/chapters/chap3 $ scriptl 
scriptl - Linux Scripting Book 
xs 


xX: 
xX? 
xX: 
xX? 
Xi 
Xi 
Xi 
xX? 


FOMANDUBWNEH 


x 
S 


End of scriptl 
guestl ~/LinuxScriptingBook/chapters/chap3 $ [] 








We start by setting variable x to 1. The while statement checks to see if x is less than 
or equal to 10 and if so, runs the commands between the do and done statements. 

It will continue to do this until x equals 11, in which case the lines after the done 
statement are then run. 


Run this on your system. It is very important to understand this script so that we can 
move on to more advanced loops. 


Let's look at another script in the next section —see if you can determine what is 
wrong with it. 
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Chapter 3 - Script 2 


#!/bin/sh 

# 

# 5/2/2017 

# 

echo "script2 - Linux Scripting Book" 
x=1 


while [ $x -ge 0 ] 
do 

echo x: $x 

let x++ 


done 
echo "End of script2" 


exit 0 


Feel free to skip the running of this one unless you really want to. Look carefully 

at the while test. It says while x is greater than or equal to 0, run the commands 
inside the loop. Is x ever going to not meet this condition? No, it is not, and this 

is what is known as an infinite loop. Don't worry; you can still end the script by 
pressing Ctrl + C (hold down the Ctrl key and press C). This will terminate the script. 


I wanted to cover infinite loops right away as you will almost certainly do this from 
time to time, and I wanted you to know how to terminate the script when it happens. 
I certainly did this a few times when I was first starting out. 


Okay let's do something more useful. Suppose you are starting a new project and 
need to create some directories on your system. You could do it one command at a 
time, or use a loop in a script. 


We'll a look at this in Script 3. 
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Chapter 3 - Script 3 


#!/bin/sh 

# 

# 5/2/2017 

# 

echo "script3 - Linux Scripting Book" 
x=1 

while [ $x -le 10 ] 

do 


echo x=$x 

mkdir chapter$x 
let x++ 
done 


echo "End of script3" 


exit 0 


This simple script assumes you are starting at the base directory. When run it will 
create directories chapter 1 through chapter 10 and then proceed to the end. 


When running scripts that make changes to your computer, it is a good idea to make 
sure the logic is correct before running it for real. For example, before running this I 
commented out the mkdir line. I then ran the script to make sure it stopped after it 
displayed that x was equal to 10. I then uncommented the line and ran it for real. 


Screen manipulation 


We'll see another script in the next section that uses a loop to put text on the screen: 
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Chapter 3 - Script 4 


#!/bin/sh 
# 
# 5/2/2017 
# 


echo "script4 - Linux Scripting Book" 


if [| S# -ne 1] ; then 

echo "Usage: script4 string" 

echo "Will display the string on every line." 
exit 255 

fi 


tput clear # clear the screen 


<e=1 
while [ $x -le SLINES ] 
do 


echo "K¥KKKKKKKKK $1 KKEKKKKKEKEN 


let x++ 


done 


exit 0 

Before executing this script run the following command: 

echo SLINES 

If the number of lines in that terminal is not displayed run the following command: 


export LINES=SLINES 








[35] 


Using Loops and the sleep Command 





Then proceed to run the script. The following is the output on my system when run 
with script4 Linux: 











guesti@bigi:~/LinuxScriptingBook/chapters/chaps 


File Edit View Search Terminal Help 
AR RRR KR RK Linux AR RR RR OR 
AR KR KK Linux OR RRR KR RK 
AR RR KR RK Linux RR RRR ORR 
AR RRR RK Linux 2K RRR ROK 
AR RRR RR Linux HR RRR KR 
OR RK RK KK Linux HR RRR KR ROKR KR 
AR RRR RK Linux RR RRR ROK 
OR RRR KK Linux OR RRR RK 
AR RRR KR RO Linux OR RRR KR RRR 
OR RRR KK Linux AR RRR ROK 
AR RK RK KR RK Linux RR RRR ROR RK 
AR RRR KK Linux OR RRR ROK 
AR RRR KR RK Linux RR RRR RR 
OR RRR KR KK Linux OR RRR KR ROR 
AR RRR KR KK Linux FR RRR KOR 
AR RR KK Linux OR RK RR KK 
OR RR RK RK Linux AR RR RK KK 


guest1 ~/LinuxScriptingBook/chapters/chap3 $ | | 








Okay, so I agree this might not be terribly useful, but it does show a few things. 
The LINES env var contains the current number of lines (or rows) in the current 
terminal. This can be useful for limiting output in more complex scripts and that 
will be shown in a later chapter. This example also shows how the screen can be 
manipulated in a script. 


If you needed to export the LINES variable, you may want to put it in your .bashrc 
file and re-source it. 


We'll take a look at another script in the next section: 


Chapter 3 - Script 5 


#!/bin/sh 

# 

# 5/2/2017 

# 

# script5 - Linux Scripting Book 


tput clear # clear the screen 


row=1 
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while [ Srow -le SLINES ] 
do 
col=1 
while [ $col -le SCOLUMNS ] 
do 
echo -n "#" 
let col++ 
done 
echo "" # output a carriage return 
let row++ 


done 


exit 0 


This is similar to Script 4 in that it shows how to display output within the confines 
of the terminal. Note, you may have to export the COLUMNS env var like we did with 
the LINES var. 


You probably noticed something a little different in this script. There is a while 
statement inside a while statement. This is called a nested loop and is used very 
frequently in programming. 


We start by declaring row=1 and then begin the outer while loop. The col var is 
then set to 1 and then the inner loop is started. This inner loop is what displays the 
character on each column of the line. When the end of the line is reached, the loop 
ends and the echo statement outputs a carriage return. The row var is incremented, 
and then the process starts again. It ends after the last line. 


By using the LINES and COLUMNS env vars only the actual screen is written to. You 
can test this by running the program and then expanding the terminal. 


When using nested loops it can be easy to get mixed up about what goes where. Here 
is something I try to do every time. When I first realize a loop is going to be needed 
in a program (which can be a script, C, or Java, and so on), I code the loop body first 
like this: 


while [ condition ] 
do 


other statements will go here 


done 
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This way I don't forget the done statement and it's also lined up correctly. If I then 
need another loop I just do it again: 


while [ condition ] 
do 
while [ condition ] 
do 


other statements will go here 
done 


done 


You can nest as many loops as you need. 


Indenting your code 


This is probably a good time to talk about indenting. In the past (that is, 30+ years 
ago) everyone used a text editor with a mono-spaced font to write their code and so 
it was relatively easy to keep everything lined up with just a one space indent. Later, 
when people started using word processors with a variable pitched font, it became 
harder to see the indentation and so more spaces (or tabs) were used. My suggestion 
is to use what you feel most comfortable with. However, with that said you may 
have to learn to read and use whatever code style that is in place for your company. 


So far we have only talked about the while statement. Now let's look at an until 
loop in the next section: 


Chapter 3 - Script 6 
cone 

# 5/3/2017 

# 


echo "Script6 - Linux Scripting Book" 


echo "This shows the while loop" 


x=1 
while [ $x -lt 11 ] # perform the loop while the condition 
do # is true 
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echo "x: $x" 
let x++ 


done 


echo "This shows the until loop" 


x= 
until [ $x -gt 10 ] # perform the loop until the condition 
do # is true 


echo "x: Sx" 
let x++ 


done 
echo "End of script6" 


exit 0 


The output: 











guesti@big1:~/LinuxScriptingBook/chapters/chap3 
File Edit View Search Terminal Help 
guestl ~/LinuxScriptingBook/chapters/chap3 $ script6 
script6 - Linux Scripting Book 


This shows the while Loop 
xX! 


0 
shows the until loop 


1 
x: 2 
x: 3 
x: 4 
x: 5 
x: 6 
x: 7 
x: 8 
x: 9 
x: 1 
This 
x: 1 
X22 
xi.3 
x: 4 
x; 5 
x: 6 
x: 7 
x: 8 
x: 9 

1 


x! 0 
End of script6 
guestl ~/LinuxScriptingBook/chapters/chap3 $ ia 
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Take a look at this script. The output from both loops is the same; however, the 
conditions are the opposite. The first loop continues while the condition is true, the 
second loop continues until the condition is true. A not-so-subtle difference so be on 
the watch for that. 


Using the for statement 


Another way to loop is to use the for statement. It is commonly used when working 
with files and other lists. The general syntax of a for loop is as follows: 
for variable in list 
do 
some commands 


done 


The list can be a collection of strings, or a filename wildcard, and so on. We can take 
a look at this in the example given in the next section. 


Chapter 3 - Script 7 
eeeass 

# 5/4/2017 

# 


echo "script7 - Linux Scripting Book" 


for i in jkl.c bob Linux "Hello there" 1 2 3 
do 
echo -n "Si " 


done 


for i in script* # returns the scripts in this directory 
do 
echo $i 


done 


echo "End of script7" 


exit 0 
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And the output on my system. This is my chap3 directory: 


guesti@big1:~/LinuxScriptingBook/chapters/chap3 
File Edit View Search Terminal Help 


guestl ~/LinuxScriptingBook/chapters/chap3 $ script7 
script7 - Linux Scripting Book 
jkl.c bob Linux Hello there 1 2 3 scriptl 


End of script7 
guestl ~/LinuxScriptingBook/chapters/chap3 $ 








The next script shows how the for statement can be used with files: 


Chapter 3 - Script 8 


#!/bin/sh 
# 

# 5/3/2017 
# 


echo "Scripts - Linux Scripting Book" 


if [ $# -eq 0 ] ; then 


echo "Please enter at least 1 parameter." 


exit 255 

fi 

for iin $* # the "$*" returns every parameter given 
do # to the script 


echo -n "Si " 


done 


echo "" # carriage return 


echo "End of scripts" 


exit 0 
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The following is the output: 


guesti@big1:~/LinuxScriptingBook/chapters/chap3 
File Edit View Search Terminal Help 


guestl ~/LinuxScriptingBook/chapters/chap3 $ scripts 

script8 - Linux Scripting Book 

Please enter at least 1 parameter. 

guestl ~/LinuxScriptingBook/chapters/chap3 $ script8 parml parm2 parm3 script* 


script8 - Linux Scripting Book 

parml parm2 parm3 scriptl script10 script1ll script12 script2 script3 script4 scr 
ipt5 script6 script7 script8 script9 

End of script8 

guestl ~/LinuxScriptingBook/chapters/chap3 $ [] 





There are a few other things you can do with the for statement, consult the man page 
of Bash for more information. 


Leaving a loop early 


Sometimes when you are coding a script, you encounter a situation where you 
would like to exit the loop early, before the ending condition is met. This can be 
accomplished using the break and cont inue commands. 


Here is a script that shows these commands. I am also introducing the sleep 
command which will be talked about in detail in the next script. 


Chapter 3 - Script 9 
oe 

# 5/3/2017 

# 


echo "script9 - Linux Scripting Book" 


FN1=/tmp/break.txt 
FN2=/tmp/continue.txt 
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while [ $x -le 1000000 ] 
do 

echo "x:S$x" 

if [ -f£ $FN1 ] ; then 


echo "Running the break command" 


rm -f£ S$FN1 
break 
ama 


if [ -£ $FN2 ] ; then 

echo "Running the continue command" 
rm -£ SFN2 

continue 


fi 


let x++ 


sleep 1 


done 


echo "x:$x" 


echo "End of script9" 


exit 0 





[43] 





Using Loops and the sleep Command 





Here's the output from my system: 


guesti@bigi:~/LinuxScriptingBook/chapters/chaps 
File Edit View Search Terminal Help 


guestl ~/LinuxScriptingBook/chapters/chap3 $ script9 
script9 - Linux Scripting Book 


unning the continue command 


unning the continue command 


OOMOAYADAUHS HW 


X 
xX! 
R 
Xx! 
xX! 
xX! 
R 
xX! 
Xx 
Xx 
Xx 
xe 
xX! 


End of script9 
guestl ~/LinuxScriptingBook/chapters/chap3 $ (] 





Run this on your system, and in another terminal cd to the /tmp directory. Run the 
command touch continue.txt and watch what happens. If you like you can do 
this multiple times (remember that up arrow recalls the previous command). Notice 
how the variable x does not get incremented when the continue command is hit. 
This is because the control goes immediately back to the while statement. 


Now run the touch break.txt command. The script will end, and again, x has not 
been incremented. This is because break immediately causes the loop to end. 


The break and continue commands are used quite often in scripts and so be sure to 
play with this one enough to really understand what is going on. 


The sleep command 


I showed the sleep command earlier, let's look at that in much more detail. In 
general, the sleep command is used to introduce a delay in the script. For example, 
in the previous script if I had not used sleep the output would have scrolled off too 
quickly to see what was going on. 
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The sleep command takes a parameter indicating how long to make the delay. 
For example, sleep 1 means to introduce a delay of one second. Here are a few 
examples: 


sleep 1 # sleep 1 second (the default is seconds) 
sleep 1s # sleep 1 second 

sleep 1m # sleep 1 minute 

sleep 1h # sleep 1 hour 

sleep 1d # sleep 1 day 


The sleep command actually has a bit more capability that what is shown here. For 
more information, please consult the man page (man sleep). 


Here's a script showing in more detail how sleep works: 


Chapter 3 - Script 10 
one 

# 5/3/2017 

# 


echo "script10 - Linux Scripting Book" 


echo "Sleeping seconds..." 
x=1 
while [ $x -le 5 ] 
do 

date 

let x++ 

sleep 1 


done 


echo "Sleeping minutes..." 
x=1 
while [ $x -le 2 ] 
do 
date 


let x++ 
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sleep 1m 


done 


echo "Sleeping hours..." 
x=1 
while [ $x -le 2 ] 
do 
date 
let x++ 
sleep 1h 


done 


echo "End of script10" 


exit 0 


And the output: 











guesti@bigi:~/LinuxScriptingBook/chapters/chaps 
File Edit View Search Terminal Help 


guestl ~/LinuxScriptingBook/chapters/chap3 $ script10 
script10 - Linux Scripting Book 
Sleeping seconds... 
i May 26 12:07:28 HST 2017 
i May 26 12:07:29 HST 2017 
i May 26 12:07:30 HST 2017 
i May 26 12:07:31 HST 2017 
i May 26 12:07:32 HST 2017 
Sleeping minutes... 
Fri May 26 12:07:33 HST 2017 
Fri May 26 12:08:33 HST 2017 
Sleeping hours... 
Fri May 26 12:09:33 HST 2017 
AC 
guestl ~/LinuxScriptingBook/chapters/chap3 $ (] 








You may have noticed that I pressed Ctrl + C to terminate the script since I didn't 
want to wait 2 hours for it to finish. Scripts of this nature are used very extensively in 
a Linux system to monitor processes, watch for files, and so on. 
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There is a common pitfall when using the sleep command that needs to be mentioned. 


Remember that the sleep command introduces a delay into 
the script. To be clear, when youcodea sleep 60 it means 
to introduce a delay of 60 seconds; it does not mean it is going 
to run the script every 60 seconds. There is a big difference. 


7 


We'll see an example of this in the following section: 


Chapter 3 - Script 11 
es 

# 5/3/2017 

# 


echo "Sscript1l1l - Linux Scripting Book" 


while [ true ] 
do 
date 
sleep 60 # 60 seconds 


done 
echo "End of script11" 


exit 0 
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This is the output on my system. It doesn't take all that long to eventually get out 
of sync: 


QGuesti@big1-~/LinuxScriptingBook/chapters/chaps | |x} 
File Edit View Search Terminal Help 


guestl ~/LinuxScriptingBook/chapters/chap3 $ scriptl1l 
scriptll - Linux Scripting Book 
Wed May 257% HST 2017 
Wed May 758: HST 2017 
May 759: HST 2017 
May :00: HST 2017 


May 
May 
May 
May 








guestl ~/LinuxScriptingBook/chapters/chap3 $ |] 


For the vast majority of scripts this is never going to be a problem. Just remember if 
what you are trying to accomplish is time critical, like trying to run a command at 
exactly 12:00 am every night, you might want to look at some other approach. Note 
that crontab will also not do this as there is about a 1 or 2 second delay before it 
runs the command. 


Watching a process 


There are a few more topics that we should look at in this chapter. Suppose you want 
to be alerted when a running process ends on your system. 


Here's a script that notifies the user when the specified process ends. Note that there 
are other ways to do this task, this is just one approach. 
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Chapter 3 - Script 12 


#!/bin/sh 
# 
# 5/3/2017 
# 


echo "script1i2 - Linux Scripting Book" 


if [| S# -ne 1] ; then 

echo "Usage: script12 process-directory" 
echo " For example: script12 /proc/20686" 
exit 255 

fi 


FN=$1 # process directory i.e. /proc/20686 
re=1 
while [ $rce -eq 1 ] 
do 
if [ ! -d SFN ] ; then # if directory is not there 
echo "Process $FN is not running or has been terminated." 
let rc=0 
else 
sleep 1 
fi 


done 


echo "End of script12" 


exit 0 
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To see this script in action run the following commands: 


¢ IJInaterminal, run script9 


¢ Inanother terminal run ps auxw | grep script9. The output will be 
something like this: 
guestl 20686 0.0 0.0 106112 1260 pts/34 S+ 17:20 0:00 / 
bin/sh ./script9 


guestl 23334 0.0 0.0 103316 864 pts/18 S+ 17:24 0:00 
grep script9 


¢ Use the process ID from script9 (in this case 20686) and use it as the 
parameter to run script12: 


$ script12 /proc/20686 


You may let it run for a bit if you want. Eventually go back to the terminal that is 
running script9 and terminate it with Ctrl + C. You will see script12 output a 
message and then also terminate. Feel free to experiment with this one as it has a lot 
of important information in it. 


You may notice that in this script I used a variable, rc, to determine when to end 
the loop. I could have used the break command as we saw earlier in this chapter. 
However, using a control variable (as it's often called) is considered to be a better 
programming style. 


A script like this can be very useful when you have started a command and then it 
takes longer than you expected for it to finish. 


For example, a while back I started a format operation on an external 1 TB USB drive 
using the mkf£s command. It took a few days to complete and I wanted to know 
exactly when so that I could continue working with the drive. 


Creating numbered backup files 


Now for a bonus here is a ready-to-run script that can be used to make numbered 
backup files. Before I came up with this (many years ago) I would go through 

the ritual of making the backup by hand. My numbering scheme was not always 
consistent, and I quickly realized it would be easier to have a script do it. This is 
something computers are really good at. 


I call this script cbs. I wrote this so long ago I'm not even sure what it stands for. 
Maybe it was Computer Backup Script or something like that. 
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Chapter 3 — Script 13 


#!/bin/sh 
# 
echo "cbS by Lewis 5/4/2017" 


if [ $# -eq 0] ; then 


echo "Usage: cbS filename(s) " 


echo " Will make a numbered backup of the files(s) given. 


echo " Files must be in the current directory." 


exit 255 


£2: 
rc=0 # return code, default is no 
for fn in $* # for each filename given on 
line 
do 

if [ ! -£ $fn ] ; then # if not found 


echo "File S$fn not found." 


re=1 # one or more files were not 
else 

ent=1 # file counter 

loop1=0 # loop flag 


while [ $loop1 -eq 0 ] 
do 
tmp=bak-S$cnt.$fn 
if [ ! -f£ $tmp ] ; then 
cp S$fn S$tmp 


echo "File "Stmp" created." 


loop1=1 # end the inner loop 
else 
let cnt++ # try the next one 
fi 
done 
fi 
done 
exit $rc # exit with return code 


" 


error 


the command 


found 
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It starts with a Usage message as it needs at least one filename to work on. 


Note that this command requires the files be in the current directory, so doing 
something like cbS /tmp/file1.txt will generate an error. 


The rc variable is initialized to o. If a file is not found, it will be set to 1. 


Now let's look at the inner loop. The logic here is a backup file will be created from 
the original file using the cp command. The naming scheme for the backup file is 
bak- (number) .original-filename where number is the next one in sequence. 
The code determines what the next number is by going through all of the bak-#. 
filename files until it doesn't find one. That one then becomes the new filename. 


Get this one going on your system. Feel free to name it whatever you like, but be 
careful to name it something other than an existing Linux command. Use the which 
command to check. 


Here is some example output on my system: 


guesti@big1:~/LinuxScriptingBook/chapters/chap3 
File Edit View Search Terminal Help 


guestl ~/LinuxScriptingBook/chapters/chap3 $ cbS 
cbS by Lewis 5/4/2017 
Usage: cbS filename(s) 

Will make a numbered backup of the files(s) given. 

Files must be in the current directory. 
guestl ~/LinuxScriptingBook/chapters/chap3 $ cbS chapter3a.txt 
cbS by Lewis 5/4/2017 

File chapter3a.txt not found. 
guestl ~/LinuxScriptingBook/chapters/chap3 $ cbS chapter3.txt 
cbS by Lewis 5/4/2017 

File bak-1.chapter3.txt created. 
guestl ~/LinuxScriptingBook/chapters/chap3 $ cbS chapter3.txt 
cbS by Lewis 5/4/2017 

File bak-2.chapter3.txt created. 
guestl ~/LinuxScriptingBook/chapters/chap3 $ cbS chap3*.png 
cbS by Lewis 5/4/2017 

File bak-1.chap3-script10.png created. 

i bak-1.chap3-scriptll.png created. 
bak-1.chap3-script13.png created. 
bak-1.chap3-scriptl.png created. 
bak-1.chap3-script4.png created. 
bak-1.chap3-script6.png created. 
bak-1.chap3-script7.png created. 
bak-1.chap3-script8.png created. 
bak-1.chap3-script9.png created. 

guestl ~/LinuxScriptingBook/chapters/chap3 $ | | 





This script could be greatly improved upon. It could be made to work with 
paths/files, and the cp command should be checked for errors. This level of 
coding will be covered in a later chapter. 
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Summary 


In this chapter we covered the different types of loop statements and how they differ 
from each other. Nesting loops and the sleep command were also covered. The 
common pitfall when using the sleep command was also mentioned, and a backup 
script was introduced to show how to easily create numbered backup files. 


In the next chapter we will go over the creation and calling of subroutines. 
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Subroutines 


This chapter shows how to create and call subroutines in a script. 
The topics covered in this chapter are as follows: 

¢ Show some simple subroutines. 

¢ Show more advanced routines. 

¢ Mention return codes again and how they work in scripts. 


In the previous chapters we have seen mostly simple scripts that were not very 
complicated. Scripts can actually do a whole lot more which we are about to see. 


First, let's start with a selection of simple but powerful scripts. These are mainly 
shown to give the reader an idea of just what can be done quickly with a script. 


Clearing the screen 


The tput clear terminal command can be used to clear the current command-line 
session. You could type tput clear all the time, but wouldn't just cls be nicer? 


Here's a simple script that clears the current screen: 


Chapter 4 - Script 1 
#!/bin/sh 

# 

# 5/8/2017 

# 

tput clear 





[55] 





Creating and Calling Subroutines 





Notice that this was so simple I didn't even bother to include a Usage message or 
return code. Remember, to make this a command on your system do this: 


¢ cd $HOME/bin 

* create/edit a file named cls 

* copy and paste the preceding code into this file 
° save the file 


* runchmod 755 cls 


You can now type cls from any terminal (under that user) and your screen will 
clear. Try it. 


File redirection 


At this point we need to go over file redirection. This is the ability to have the output 
from a command or script be copied into a file instead of going to the screen. This is 
done by using the redirection operator, which is really just the greater than sign. 


Here is the screenshot of some commands that were run on my system: 


guesti@big1:~/LinuxScriptingBook/chapters/chap4 
File Edit View Search Terminal Help 


guestl ~/LinuxScriptingBook/chapters/chap4 $ ifconfig > ifconfig.txt 
guestl ~/LinuxScriptingBook/chapters/chap4 $ cat ifconfig.txt 
etho Link encap:Ethernet HWaddr E0:Z9:95:5B:BZ:87 
inet addr:192.168.1.20 Bcast:192.168.1.255 Mask:255.255.255.0 
inet6 addr: fe80::e269:95ff:fe5b:b687/64 Scope:Link 
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 
RX packets:194702818 errors:0 dropped:30 overruns:0 frame:0 
TX packets:354190522 errors:0 dropped:0 overruns:0 carrier:0 
collisions:0 txqueuelen: 1000 
RX bytes:146133079920 (136.0 GiB) TX bytes:390554310707 (363.7 GiB) 
Interrupt:20 Memory: fbac0000- fbae0000 


Link encap:Local Loopback 

inet addr:127.0.0.1 Mask:255.0.0.0 

inet6 addr: ::1/128 Scope:Host 

UP LOOPBACK RUNNING MTU:65536 Metric:1 

RX packets:253218017 errors:0 dropped:0 overruns:0 frame:0 

TX packets:253218017 errors:0 dropped:0 overruns:0 carrier:0 
collisions:0 txqueuelen:0 

RX bytes:19885357492 (18.5 GiB) TX bytes:19885357492 (18.5 GiB) 


Link encap:Ethernet HWaddr 52:Z4:00:EC:ZF:A9 

inet addr:192.168.122.1 Bcast:192.168.122.255 Mask:255.255.255.0 
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 

RX packets:0 errors:0 dropped:0 overruns:0 frame:0 

TX packets:37 errors:0 dropped:0 overruns:® carrier:0 

collisions:0 txqueuelen:0 

RX bytes:0 (0.0 b) TX bytes:2200 (2.1 KiB) 





guest1 ~/LinuxScriptingBook/chapters/chap4 $ | | 





[ 56] 





Chapter 4 





As you can see, the output from the ifconfig command was sent (or redirected) to 
the ifconfig.txt file. 


Command piping 
Now let's look at command piping, which is the ability to run a command and have 
the output from it serve as the input to another command. 


Suppose a program or script named loop1 is running on your system and you 
want to know the PID of it. You could run the ps auxw command to a file, and 
then grep the file for loop1. Alternatively, you could do it in one step by using 
a pipe as follows: 


guesti@big1:~/LinuxScriptingBook/chapters/chap4 
File Edit View Search Terminal Help 


guestl ~/LinuxScriptingBook/chapters/chap4 $ ps auxw | grep loopl 
1587 0.0 0.0 106640 1720 pts/4 S+ May19 0:08 /bin/sh ./loop1l 
15236 0.0 0.0 103320 864 pts/36  S+ 17:31 0:00 grep loop1l 


guestl ~/LinuxScriptingBook/chapters/chap4 $ ] 








Pretty cool, right? This is a very powerful feature in a Linux system and is used 
extensively. We will be seeing a lot more of this soon. 


The next section shows another very short script using some command piping. This 
clears the screen and then shows only the first 10 lines from dmesg: 


Chapter 4 - Script 2 
#!/bin/sh 

# 

# 5/8/2017 

# 

tput clear 


dmesg | head 
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And here is the output: 


guesti@big1:~/LinuxScriptingBook/chapters/chap4 
File Edit View Search Terminal Help 


Initializing cgroup subsys cpuset 

Initializing cgroup subsys cpu 

Linux version 2.6.32-642.e16.x86 64 (mockbuild@workerl.bsys.centos.org) (gcc version 

4.4.7 20120313 (Red Hat 4.4.7-17) (GCC) ) #1 SMP Tue May 10 17:27:01 UTC 2016 

Command line: ro root=UUID=b92656f9-c523-4357-9313-77c2c80a7115 rd NO LUKS rd NO LVM 
LANG=en_US.UTF-8 rd_ NO MD SYSFONT=latarcyrheb-sunl6 crashkernel=128M KEYBOARDTYPE=pc 
KEYTABLE=us rd_NO DM rhgb quiet 


KERNEL supported cpus: 

Intel GenuineIntel 

AMD AuthenticAMD 

Centaur CentaurHauls 
BIOS-provided physical RAM map: 

BIOS-e820: 0000000000000000 - 0000000000099800 (usable) 
guestl ~/LinuxScriptingBook/chapters/chap4 $ [] 





The next section shows file redirection. 


Chapter 4 - Script 3 
#!/bin/sh 

# 

# 5/8/2017 

# 

FN=/tmp/dmesg.txt 

dmesg > SFN 

echo "File SFN created." 


exit 0 
Try it on your system. 


This shows how easy it is to create a script to perform commands that you would 
normally type on the command line. Also notice the use of the FN variable. If you 
want to use a different filename later, you only have to make the change in one place. 


Subroutines 


Now let's really get into subroutines. To do this we will use more of the tput 
commands: 


tput cup <row><col> # moves the cursor to row, col 


tput cup 0 0 # cursor to the upper left hand side 
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tput cup SLINES $COLUMNS # cursor to bottom right hand side 
tput clear # clears the terminal screen 
tput smso # bolds the text that follows 


tput rmso # un-bolds the text that follows 


Here is the script. This was mainly written to show the concept of a subroutine, 
however, it can also be used as a guide on writing interactive tools. 


Chapter 4 - Script 4 
#!/bin/sh 
# 6/13/2017 


# script4 


# Subroutines 
cls() 

{ 

tput clear 


return 0 


} 


home () 


i 
tput cup 0 0 


return 0 


} 


end () 


{ 


let x=$COLUMNS-1 
tput cup $LINES $x 


echo -n "X" # no newline or else will scroll 


} 


bold() 


{ 


tput smso 
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} 


unbold () 


{ 


tput rmso 


} 


underline () 


{ 


tput smul 


} 


normalline () 


{ 


tput rmul 


} 


# Code starts here 
ro=0 


if [| S# -ne 1] ; then 


echo "Usage: script4 parameter" 


echo "Where parameter can be: 


# return code 


echo " home - put an X at the home position" 

echo " cls - clear the terminal screen" 

echo " end - put an X at the last screen position" 
echo " bold - bold the following output" 





echo " underline - underline the following output" 


exit 255 
fi 
parm=$1 
if [ "Sparm" = "home" ] 


# main parameter 1 
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echo "Calling subroutine home." 
home 


echo -n "X" 


elif [ "Sparm" = "cls" ] ; then 
cls 
elif [ "Sparm" = "end" ] ; then 


echo "Calling subroutine end." 

end 
elif [ "Sparm" = "bold" ] ; then 

echo "Calling subroutine bold." 

bold 

echo "After calling subroutine bold." 
unbold 

echo "After calling subroutine unbold." 
elif [ "Sparm" = "underline" ] ; then 
echo "Calling subroutine underline." 
underline 

echo "After subroutine underline." 
normalline 

echo "After subroutine normalline." 


else 





echo "Unknown parameter: $parm" 
re=1 


fi 


exit $rc 
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The following is the output: 


guesti@big1i:~/LinuxScriptingBook/chapters/chap4 
File Edit View Search Terminal Help 


guestl ~/LinuxScriptingBook/chapters/chap4 $ script4 
script4 - Linux Scripting Book 
Usage: script4 parameter 
Where parameter can be: 
home - put an X at the home position 
cls - clear the terminal screen 
end - put an X at the last screen position 
bold - bold the following output 
underline - underline the following output 
guestl ~/LinuxScriptingBook/chapters/chap4 $ script4 bold 
script4 - Linux Scripting Book 
Calling subroutine bold. 
fter calling subroutine bold. 
After calling subroutine unbold. 
guestl ~/LinuxScriptingBook/chapters/chap4 $ script4 underline 
script4 - Linux Scripting Book 
Calling subroutine underline. 
After subroutine underline. 
After subroutine normalline. 
guestl ~/LinuxScriptingBook/chapters/chap4 $ (] 








Try this on your system. If you run it with the home parameter it might look a little 
strange to you. The code puts a capital x at the home position (0,0) and this causes 
the prompt to print one character over. Nothing is wrong here, it just looks a little 
weird. Don't worry if this still doesn't make sense to you, just go ahead and look at 
Script 5. 


Using parameters 


Okay, let's add some routines to this script to show how to use parameters with a 
subroutine. In order to make the output look better the cls routine is called first to 
clear the screen: 


Chapter 4 - Script 5 
#!/bin/sh 

# 6/13/2017 

# scripts 


# Subroutines 
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cls() 


{ 


tput clear 


return 0 


} 


home () 


{ 
tput cup 0 0 


return 0 


} 


end () 


: 


let x=$SCOLUMNS-1 
tput cup $LINES $x 


echo -n "X" 


} 


bold() 


{ 


tput smso 


} 


unbold() 


{ 


tput rmso 


} 


underline () 


{ 


tput smul 


} 


normalline() 


{ 


# no newline or else will scroll 
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tput rmul 


} 


move () 
{ 
tput cup $1 $2 


} 


movestr () 

{ 

tput cup $1 $2 
echo $3 


} 


# Code starts here 


cls 
better 


rc=0 


if [| S# -ne 1] ; then 


# move cursor to row, 


# move cursor to row, 


col 


col 


# clear the screen to make the output look 


# return code 


echo "Usage: script5 parameter" 


echo "Where parameter can be: " 


echo " home - put an X at the home position" 

echo " cls - clear the terminal screen" 

echo " end - put an X at the last screen position" 
echo " bold - bold the following output" 


echo " underline - underline the following output" 





echo " move - move cursor to row,col" 
echo " movestr - move cursor to row,col and output string" 
exit 255 

geal 

parm=$1 # main parameter 1 


if [ "Sparm" = "home" ] 


then 
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home 


echo -n "X" 


elif [ "Sparm" = "cls" ] ; then 
cls 

elif [ "Sparm" = "end" ] ; then 
move 0 0 


echo "Calling subroutine end." 

end 

elif [ "Sparm" = "bold" ] ; then 

echo "Calling subroutine bold." 

bold 

echo "After calling subroutine bold." 
unbold 

echo "After calling subroutine unbold." 
elif [ "Sparm" = "underline" ] ; then 
echo "Calling subroutine underline." 
underline 

echo "After subroutine underline." 


normalline 





echo "After subroutine normalline." 
elif [ "Sparm" = "move" ] ; then 

move 10 20 

echo "This line started at row 10 col 20" 
elif [ "Sparm" = "movestr" ] ; then 
movestr 15 40 "This line started at 15 40" 
else 

echo "Unknown parameter: $parm" 

rc=l1 


fi 


exit $rc 
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Since this script only has two extra functions you can just run them. This will be 
shown one command at a time as follows: 


guestl1 $ scripts 


Guesti@bigi:~/LinuxScriptingBook/chapters/chap4  —j[m| pq 
File Edit View Search Terminal Help 


Usage: script5 parameter 
Where parameter can be: 
home - put an X at the home position 
cls clear the terminal screen 
end put an X at the last screen position 
bold bold the following output 
underline underline the following output 
move move cursor to row,col 
movestr move cursor to row,col and output string 
guestl ~/LinuxScriptingBook/chapters/chap4 $ (] 





guestl $ script5 move 











guesti@big1:~/LinuxScriptingBook/chapters/chap4 
File Edit View Search Terminal Help 


This line started at row 10 col 20 
guestl ~/LinuxScriptingBook/chapters/chap4 $ [] 





guestl1 $ script5 movestr 











guesti@big1:~/LinuxScriptingBook/chapters/chap4 
File Edit View Search Terminal Help 


This line started at 15 40 
guestl ~/LinuxScriptingBook/chapters/chap4 $ [] 





Since we are now placing the cursor at a specific location, the output should make 
more sense to you. Notice how the command-line prompt reappears where the last 
cursor position was. 
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You probably noticed that the parameters to a subroutine work just like with a script. 
Parameter 1 is $1, parameter 2 is $2, and so on. This is good and bad, good because 
you don't have to learn anything radically different. But bad in that it is very easy to 
get the $1, $2, vars mixed up if you are not careful. 


A possible solution, and the one I use, is to assign the $1, $2, and so on variables in 
the main script to a variable with a good meaningful name. 


For example, in these example scripts I set parm1 equal to $1 (parm1=$1), 
and so on. 


Take a good look at the script in the next section: 


Chapter 4 - Script 6 
#!/bin/sh 

# 

# 6/13/2017 

# script6 


# Subroutines 
subl () 
{ 
echo "Entering subl1" 
rce1=0 # default is no error 
if [ S# -ne 1] ; then 
echo "subl requires 1 parameter" 
saeu kal # set error condition 
else 
echo "1st parm: $1" 
fi 


echo "Leaving sub1" 


return $rcl # routine return code 


} 


sub2 () 


{ 


echo "Entering sub2" 
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rce2=0 # default is no error 
if [ S# -ne 2 ] ; then 

echo "sub2 requires 2 parameters" 

re2=1 # set error condition 
else 

echo "1st parm: $1" 

echo "2nd parm: $2" 

fi 

echo "Leaving sub2" 


return $rc2 # routine return code 


sub3 () 
{ 
echo "Entering sub3" 
rc3=0 # default is no error 
if [ S# -ne 3 ] ; then 
echo "sub3 requires 3 parameters" 
re3=1 # set error condition 
else 
echo "1st parm: $1" 
echo "2nd parm: $2" 
echo "3rd parm: $3" 
fi 
echo "Leaving sub3" 


return $rc3 # routine return code 


cls() # clear screen 


{ 


tput clear 


return $? # return code from tput 


} 


causeanerror () 


{ 








[ 68] 


Chapter 4 





echo "Entering causeanerror" 
tput firephasers 


return $? # return code from tput 


} 


# Code starts here 
cls # clear the screen 
rc=$? 
echo "return code from cls: $rc" 
rc=0 # reset the return code 
if [| S# -ne 3 ] ; then 
echo "Usage: script6 parameterl parameter2 parameter3" 


echo "Where all parameters are simple strings." 


exit 255 

fi 
parml1=$1 # main parameter 1 
parm2=$2 # main parameter 2 
parm3=$3 # main parameter 3 


# show main parameters 


echo "parml: S$parml parm2: $parm2 parm3: S$parm3" 


subl "subl-parml1" 


echo "return code from subl1: $?" 


sub2 "sub2-parml1" 


echo "return code from sub2: $?" 


sub3 Sparml Sparm2 S$parm3 


echo "return code from sub3: $?" 


causeanerror 


echo "return code from causeanerror: $?" 


exit $rc 
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And here's the output 


guesti@big1:~/LinuxScriptingBook/chapters/chap4 
File Edit View Search Terminal Help 


Chapter 4 - Script6 

return code from cls: 0 

parml: Hello parm2: Mister parm3: Spock 
Entering subl 

lst parm: subl-parml 

Leaving subl 

return code from subl: 0 

Entering sub2 

sub2 requires 2 parameters 

Leaving sub2 

return code from sub2: 1 

Entering sub3 

lst parm: Hello 

2nd parm: Mister 

3rd parm: Spock 

Leaving sub3 

return code from sub3: 0 

Entering causeanerror 

tput: unknown terminfo capability 'firephasers' 
return code from causeanerror: 4 

guestl ~/LinuxScriptingBook/chapters/chap4 $ [] 





There are some new concepts here and so we will go through this one very carefully. 


First, we define the subroutines. Notice that a return code has been added. A cls 
routine has also been included so that a return code could be shown. 


Weare now at the start of the code. The cls routine is called and then the return 
value from it is stored in the rc variable. Then the echo statement showing which 
script this is will be displayed. 


So, why did I have to put the return code from the cls command into the rc var? 
Couldn't I have just displayed it after the echo of the script title? No, because the 
echo $? always refers to the command immediately preceding it. This is easy to 

forget so make sure you understand this point. 


Okay, so now we reset the rc var to 0 and continue on. I could have used a different 
variable for this, but since the value of rc is not going to be needed again I chose to 
just reuse the rc variable. 


Now, at the check for parameters, the Usage statement will be displayed if three 
parameters are not there. 
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After three parameters are entered we display them. This is always a good idea 
especially when first writing a script/ program. You can always take it out later if it is 
not needed. 


The first subroutine, sub1, is run with 1 parameter. This is checked and an error is 
displayed if needed. 


The same thing happens with sub2, but in this case I intentionally set it to run with 
only one parameter so that the error message would be displayed. 


For sub3, you can see that the main parameters are still accessible from a subroutine. 
In fact, all of the named variables are, and also the wildcard * and other file 
expansion tokens. Only the main script parameters cannot be accessed, which is why 
we put them into variables. 


The final routine was created in order to show how errors can be handled. You can 
see that the tput command itself displayed the error, and then we also captured it in 
the script. 


Finally, the script exits with the main rc variable. 


As was mentioned earlier, this script has a lot in it so be sure to study it carefully. 
Note that when I wanted to show an error in tput, I just assumed that firephasers 
was going to be an unknown command. I would have been rather surprised if some 
phasers had actually shot out of (or worse, into) my computer! 


Making a current backup of your work 


And now, for another bonus the next section shows the script I used to backup my 
current book's chapter every 60 seconds: 


Chapter 4 — Script 7 

#!/bin/sh 

# 

# Auto backs up the file given if it has changed 
# Assumes the cbS command exists 

# Checks that ../back exists 


# Copies to specific USB directory 
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# Checks if filename.bak exists on startup, copy if it doesn't 


echo "autobackup by Lewis 5/9/2017 A" 

if [| S# -ne 3 ] ; then 

echo "Usage: autobackup filename USB-backup-dir delay" 
exit 255 

fi: 


# Create back directory if it does not exist 


if [ ! -d back ] ; then 

mkdir back 

fi 

FN=$1 # filename to monitor 
USBdir=$2 # USB directory to copy to 
DELAY=$3 # how often to check 

if [ ! -£ S$FN ] ; then # if no filename abort 


echo "File: SFN does not exist." 
exit 5 


£u 


if [ ! -£ S$FN.bak ] ; then 
cp SFN SFN.bak 
fi 


filechanged=0 
while [1 ] 
do 
cmp SFN SFN.bak 
rce=$? 
if [ Src -ne 0 ] ; then 
cp SFN back 
cp S$FN SUSBdir 
cd back 
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cbS SFN 

cd 

cp SFN SFN.bak 

filechanged=1 
fi 


sleep SDELAY 


done 


And for the output on my system 











guesti@big1:~/LinuxScriptingBook/chapters/chap4 
File Edit View Search Terminal Help 


guestl ~/LinuxScriptingBook/chapters/chap4 $ script7 chapter4.txt /usb/bookbackup 60 ~« 
autobackup by Lewis 5/9/2017 A 

chapter4.txt chapter4.txt.bak differ: byte 37, line 4 

cbS by Lewis 5/4/2017 

File bak-4.chapter4.txt created. 

chapter4.txt chapter4.txt.bak differ: byte 38, line 5 

cbS by Lewis 5/4/2017 

File bak-5.chapter4.txt created. 


chapter4.txt chapter4.txt.bak differ: byte 38, line 5 
cbS by Lewis 5/4/2017 

File bak-6.chapter4.txt created. 

chapter4.txt chapter4.txt.bak differ: byte 3304, line 86 
cbS by Lewis 5/4/2017 

File bak-7.chapter4.txt created. 





There's not much in this script that we have not already covered. The informal 
comments at the top are mainly for me, so that I don't forget what I wrote or why. 


The parms are checked and the back subdirectory is created if it does not already 
exist. I never seem to be able to remember to create it, so I let the script do it. 


Next, the main variables are set up and then the . bak file is created if it doesn't exist 
(this helps with the logic). 


In the while loop, which you can see runs forever, the cmp Linux command is used 
to see if the original file has changed from the backup file. If so, the cmp command 
returns non-zero and the file is copied back to the subdir as a numbered backup 
using our cbs script. The file is also copied to the backup directory, which in this 
case is my USB drive. The loop continues until I start a new chapter, in which case I 
press Ctrl + C to quit. 
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This is a good example of script automation, which will be covered in more detail in 
Chapter 6, Automating Tasks with Scripts. 


Summary 


We started with some very simple scripts and then proceeded to show some simple 
subroutines. 


We then showed some subroutines that take parameters. Return codes were 
mentioned again to show how they work in subroutines. We including several scripts 
to show the concepts, and also included a special bonus script at no extra charge. 


In the next chapter we will go over how to create interactive scripts. 
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This chapter shows how to read the keyboard in order to create interactive scripts. 
The topics covered in this chapter are: 


¢ How to use the read built-in command to query the keyboard. 
¢ The different ways to use read. 


¢ The use of traps (interrupts). 
The reader will learn how to create interactive scripts. 


The scripts we have looked at up to this point have run without much user 
interaction. The read command is used to create scripts that can query the keyboard. 
The code can then take action based on the input. 


Here is a simple example: 


Chapter 5 - Script 1 


#!/bin/sh 
# 

# 5/16/2017 
# 


echo "scripti1 - Linux Scripting Book" 





echo "Enter 'q' to quit." 
rc=0 

while [ $rce -eq 0 ] 

do 





echo -n "Enter a string: " 
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read str 

echo "str: $str" 

if [ "$str" = "q" ] ; then 
re=1 

fi 


done 


echo "End of script1" 


exit 0 


And here is the output when run on my system: 





fe] guesti@big1:~/LinuxScriptingBook/chapters/chap5 _| Ox 
File Edit View Search Terminal Help 


guestl ~/LinuxScriptingBook/chapters/chap5 $ scriptl E 
scriptl - Linux Scripting Book 

Enter ‘q' to quit. 

Enter a string: Hello 

str: Hello 

Enter a string: There 

str: There 

Enter a string: What's for dinner? 

str: What's for dinner? 

Enter a string: This has "quotes" in it. 
str: This has "quotes" in it. 

Enter a string: q 

str: q 

End of scriptl 

guestl ~/LinuxScriptingBook/chapters/chap5 $ 


























This is a good one to run on your system. Try several different strings, numbers, and 
so on. Notice how the returned string contains whitespace, special characters, and so 
on. You don't have to quote anything, and if you do those will be returned as well. 


You can also use the read command to put a simple pause into your script. This will 
allow you to see the output before it scrolls off the screen. It can also be used when 
debugging which will be shown in Chapter 9, Debugging Scripts. 


The following script shows how to create a pause when the output gets to the last 
line of the screen: 


Chapter 5 - Script 2 
#!/bin/sh 

# 

# 5/16/2017 

# Chapter 5 - Script 2 
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# 
linecnt=1 # line counter 
loop=0 # loop control var 


while [ Sloop -eq 0 ] 
do 
echo "S$linecnt $RANDOM" # display next random number 
let linecnt++ 
if [ $linecnt -eq $LINES ] ; then 
linecnt=1 


echo -n "Press Enter to continue or q to quit: " 


read str # pause 
if [ "Sstr" = "q" ] ; then 
loop=1 # end the loop 
Fi: 
fi 
done 


echo "End of script2" 


exit 0 


And here is the output when run on my system: 











guesti@big1:~/LinuxScriptingBook/chapters/chap5 
File Edit View Search Terminal Help 


30676 
9687 
31192 
8838 
11014 
26143 
9906 
10718 


1 
2 
3 
4 
5 
6 
7 
8 
9 


Press Enter to continue or q to quit: | | 
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I pressed Enter twice, and then Q and Enter on the last one. 


Let's try something a bit more interesting. This next script shows how to fill an array 
with values taken from the keyboard: 


Chapter 5 - Script 3 


#!/bin/sh 

# 

# 5/16/2017 

# 

echo "script3 - Linux Scripting Book" 
if [ "$1" = "--help" ] ; then 


echo "Usage: script3" 
echo " Queries the user for values and puts them into an array." 


echo " Entering 'q' will halt the script." 


echo " Running 'script3 --help' shows this Usage message." 
exit 255 

fi 

x=0 # subscript into array 

loop=0 # loop control variable 


while [ Sloop -eq 0 ] 
do 
echo -n "Enter a value or q to quit: " 


read value 


if [ "$value" = "q" ] ; then 
loop=1 
else 


array [$x] ="$value" 
let x++ 
mal 


done 


let size=x 


x=0 
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while [ $x -lt Ssize ] 


do 


echo "array $x: ${array [x] }" 


let x++ 


done 


echo "End of script3" 


exit 0 


And the output: 











guesti@bigi:~/LinuxScriptingBook/chapters/chap5s 


File Edit View Search Terminal 


Help 


guestl ~/LinuxScriptingBook/chapters/chap5 $ script3 
i - Linux Scripting Book 


value 
value 
value 
value 
value 
value 
value 
123 
456 
Bob 
Joe 


a 
a 
a 
a 
a 
a 
a 
0: 
ae 
2: 
33 
4: 
5 


or 
or 
or 
or 
or 
or 
or 


to 
to 
to 
to 
to 
to 
to 


quit: 
quit: 
quit: 
quit: 
quit: 
quit: 
quit: 


123 

456 

Bob 

Joe 

This string contains some blanks. 
This string contains >,<,?,:,". 

q 


This string contains some blanks. 
: This string contains >,<,?,:,". 
End of script3 


guestl ~/LinuxScriptingBook/chapters/chap5 $ [] 





Since this script does not require any parameters I decided to add a Usage statement. 
This will display if the user runs it with --help and is a common feature in many 
system scripts and programs. 


The only thing new in this script is the read command. The loop and array 
variables were discussed in an earlier chapter. Note again that, with the read 
command what you type is what you get. 
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Now let's create a complete interactive script. But first we need to check the size of 
the current terminal. If it is too small, the output of your script may become garbled 
and the user may not know why or how to fix it. 


The following script contains a subroutine that checks the size of the terminal: 


Chapter 5 - Script 4 


#!/bin/sh 
# 
# 5/16/2017 
# 
echo "script4 - Linux Scripting Book" 
checktermsi ze () 
{ 
rce1=0 # default is no error 
if [[ $LINES -1t $1 || S$COLUMNS -1lt $2 ]] ; then 
rel=1 # set return code 
fi 


return $rcl1 


} 


rc=0 # default is no error 
checktermsize 40 90 # check terminal size 
rc=$? 


if [| Src -ne 0 ] ; then 
echo "Return code: $rce from checktermsize" 


fi 


exit $rc 


Run this on your system with different-sized terminals to check the result. As you 
can see from the code, it's okay if the terminal is larger than needed; it just can't be 
too small. 








[ 80] 


Chapter 5 





“G 


A word about terminal sizes: When using the tput cursor 
movement commands remember that it is row then column. 
However, most modern GUIs go by column then row. This is 
unfortunate as it is very easy to get them mixed up. 


Now let's look at a full interactive script: 


Chapter 5 - Script 5 


#!/bin/sh 
# 

# 5/27/2017 
# 


echo "script5 - 


# Subroutines 


cls () 


{ 


tput clear 


} 


move () 


{ 


tput cup $1 $2 


} 


movestr () 


{ 
tput cup $1 $2 


echo -n "$3" 


} 


Linux Scripting Book" 


# move cursor to row, col 


# move cursor to row, col 


# display string 


checktermsize () 

{ 

rc1=0 # default is no error 
if [[ $LINES -1t $1 || S$COLUMNS -1lt $2 ]] ; then 
rel=1 # set return code 
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fa 
return $rcl1 


} 


init ( # set up the cursor position array 











srow[0]=2; scol[0]=7 # name 
srow[1]=4; scol[1]=12 # address 1 
srow[2]=6; scol[2]=12 # address 2 
srow[3]=8; scol[3]=7 # city 
srow[4]=8; scol[4]=37 # state 
srow[5]=8; scol[5]=52 # zip code 
srow[6]=10; scol[6]=8 # email 
drawscreen () # main screen draw routine 
cls # clear the screen 


movestr 5 "Chapter 5 - Script 5" 


movestr "Name: " 


"Address 1:" 


2 
1 
movestr il 
1 


movestr "Address 2:" 


movestr 30° "States" 


42 "Zip code:" 


0 
2 
4 
6 

movestr 8 1 "City:" 
8 
movestr 8 
L 


movestr 10 1 "Email:" 


getdata() 

j 

x=0 # array subscript 

rcl1=0 # loop control variable 


while [ $rcl -eq 0 ] 
do 
row=${srow[x]}; col=${scol [x] } 


move Srow S$col 
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read array [x] 


let x++ 
if [ $x -eq $sizeofarray ] ; then 
rcel=1 
fi 
done 
return 0 
} 
showdata () 
{ 
fn=0 
echo "" 
read -p "Enter filename, or just Enter to skip: " filename 
if [ -n "$filename" ] ; then # if not blank 


echo "Writing to '$filename'" 


fn=1 # a filename was given 
fi 
echo "" # skip 1 line 


echo "Data array contents: " 
y=0 
while [ Sy -lt $sizeofarray ] 
do 
echo "$y - ${array[$y] }" 
if [ $fn -eq 1] ; then 
echo "Sy - ${array[$y] }">>"$filename" 
fi 
let y++ 
done 


return 0 


} 


# Code starts here 


sizeofarray=7 # number of array elements 


if [ "$1" = "--help" ] ; then 
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echo "Usage: script5 --help" 

echo " This script shows how to create an interactive screen program." 
exit 255 

fi 


checktermsize 25 80 
rc=$? 
if [ Src -ne 0 ] ; then 


echo "Please size the terminal to 25x80 and try again." 


exit 1 

fi 

init # initialize the screen array 
drawscreen # draw the screen 

getdata # cursor movement and data input routine 
showdata # display the data 

exit 0 


Here is some example output: 








guesti@big1:~/LinuxScriptingBook/chapters/chap5 
File Edit View Search Terminal Help 
Chapter 5 - Script 5 


Name: James Lewis 

Address 1: 12345 Some Street 

Address 2: Apt A 

City: Pearl City State: HI Zip code: 56789 
Email: jim@jklewis.com 


Enter filename, or just Enter to skip: jiml.txt 
Writing to 'jiml.txt' 


Data array contents: 
@ - James Lewis 

1 12345 Some Street 
2 Apt A 

3 Pearl City 

4 HI 

5 56789 

6 jim@jklewis.com 

9 


uestl ~/LinuxScriptingBook/chapters/chap5 $ [] 














[84] 


Chapter 5 





There is a lot of new information here, so let's take a look. First the subroutines are 
defined, and you can see we included the checktermsize subroutine from the 
preceding Script 4. 


The init routine sets up the cursor placement array. It's good programming practice 
to put initial values in a subroutine, particularly if it is going to be called again. 


The drawscreen routine displays the initial form. Note that I could have used the 
values in the srow and scol array here, however, I didn't want the script to look 
too cluttered. 


Look very carefully at the getdata routine because this is where the fun begins: 


¢ First the array subscript x and control var rc1 are set to 0. 

¢ In the loop the cursor is placed at the first position (Name:). 

¢ The keyboard is queried and the user's input goes into the array at sub x. 

* xis incremented and we go to the next field. 

* If xis equal to the size of the array we leave the loop. Keep in mind that we 
start counting at 0. 


The showdata routine displays the array data and then we are done. 


' 
+ Note that if the script is run with the --help option 
the Usage message is displayed. 


This is just a small example of an interactive script to show the basic concepts. In a 
later chapter we will go into this in more detail. 


The read command can be used in a number of different ways. Here are a few 
examples: 

read var 

Wait for input of characters into the variable var. 

read -p "string" var 


Display contents of string, stay on the line, and wait for input. 


read -p "Enter password:" -s var 


Display "Enter password:", but do not echo the typing of the input. Note 
that a carriage return is not output after Enter is pressed. 


read -n 1 var 
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The -n option means to wait for that number of characters and then continue, it does 
not wait for an Enter press. 


In this example it will wait for 1 char and then go. This can be useful in utility scripts 
and games: 


Chapter 5 - Script 6 
#!/bin/sh 

# 

# 5/27/2017 

# 

echo "Chapter 5 - Script 6" 


rc=0 # return code 
while [ $rce -eq 0 ] 
do 
read -p "Enter value or q to quit: " var 
echo "var: Svar" 
if [ "Svar" = "q" ] ; then 
re=1 
fi 


done 


rc=0 # return code 
while [ $rce -eq 0 ] 
do 
read -p "Password: " -s var 
echo "" # carriage return 
echo "var: Svar" 
if [ "Svar" = "q" ] 7 then 
rc=1 
fi 


done 


echo "Press some keys and gq to quit." 
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re=0 # return code 


while [ $re -eq 0 ] 


do 

read -n 1 -s var # wait for 1 char, does not output it 
echo $var # output it here 

if [ "Svar" = "gq" ] ; then 

ré=1 

fi 
done 
exit $re 
And the output: 











guesti@bigi:~/LinuxScriptingBook/chapters/chap5 =| OX 














File Edit View Search Terminal Help 


guestl ~/LinuxScriptingBook/chapters/chap5 $ script6 = 
Chapter 5 - Script 6 

Enter value or q to quit: Hello There 
var: Hello There 

Enter value or q to quit: Linux Rules 
var: Linux Rules 

Enter value or q to quit: q 

var: q 

Password: 

var: thisisapassword 

Password: 

var: q 

Press some keys and q to quit. 


3 
5 
7 
y 
J 
i 
l 
q 
9g 


uestl ~/LinuxScriptingBook/chapters/chap5 $ (] 





The comments in the script should make this one pretty self explanatory. The read 
command has a few more options, one of which will be shown in the next script. 
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Another way to query the keyboard is by using what is called a trap. This is a 
subroutine that is accessed when a special key sequence is pressed, such as Ctrl + C. 


Here is an example of using a trap: 


Chapter 5 - Script 7 


#!/bin/sh 
# 

# 5/16/2017 
# 


echo "script7 - Linux Scripting Book" 
trap catchCtr1c INT # Initialize the trap 


# Subroutines 


catchCtrl1C() 


{ 


echo "Entering catchCtrlC routine." 


} 


# Code starts here 
echo "Press Ctrl-C to trigger the trap, 'Q' to exit." 


loop=0 
while [ Sloop -eq 0 ] 


do 

read -t 1 -n 1 str # wait 1 sec for input or for 1 char 
rc=$? 

if [ $re -gt 128 ] ; then 


echo "Timeout exceeded." 


fi 


if [ "Sstr" = "Q" ] ; then 


echo "Exiting the script." 
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loop=1 
fi 


done 


exit 0 


Here is the output on my system: 














fe] guesti@big1:~/LinuxScriptingBook/chapters/chap5S 


File Edit View Search Terminal Help 


guestl ~/LinuxScriptingBook/chapters/chap5 $ script7 
script7 - Linux Scripting Book 

Press Ctrl-C to trigger the trap, 'Q' to exit. 
Timeout exceeded. 

Timeout exceeded. 

Timeout exceeded. 

Timeout exceeded. 

Timeout exceeded. 

“CEntering catchCtrlC routine. 

Timeout exceeded. 

Timeout exceeded. 

Timeout exceeded. 

Timeout exceeded. 

“CEntering catchCtrlC routine. 

Timeout exceeded. 

dfTimeout exceeded. 

gyujhjim lewisfghTimeout exceeded. 

Timeout exceeded. 

Timeout exceeded. 

Timeout exceeded. 

QExiting the script. 

guestl ~/LinuxScriptingBook/chapters/chap5 $ U 





Try running this one on your system. Press some keys and see the response. Press 
Ctrl + Ca few times as well. When done press Q. 


That read statement needs some further explanation. Using read with the -t option 
(timeout) means to wait that many seconds for a character. If one is not input in 

the allotted time it will return a code with a value greater than 128. As we have 

seen before, the -n 1 option tells read to wait for 1 character. So this means we are 
waiting 1 second for 1 character. This is another way read can be used to create a 
game or other interactive script. 
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_ Using a trap is a good way to catch an accidental press of Ctrl + C 
& which could cause data to be lost. One word of caution however, if 
GS you do decide to catch Ctrl + C make sure your script has some other 
way to exit. In the simple script above the user must type a Q to exit. 


If you get yourself into a situation where you can't exit a script you can use the 
kill command. 


For example, if I had needed to stop script7 the directions would be follows: 


guestl $ ps auxw | grep script7 





guestl 17813 0.0 0.0 106112 
./script7 

guestl 17900 0.0 0.0 103316 
script7 

guestl 29880 0.0 0.0 10752 
script7 

guestl $ kill -9 17813 

guestl $ 


1252 pts/32 


864 pts/18 


1148 pts/17 


S+ 17:23 0:00 /bin/sh 


S+ 17:23 0:00 grep 


S+ 16:47 0:00 kw 


In the terminal where script7 was running you will see it has stopped with the 
word Killed in it. 


Note, be sure to kill the right process! 


In the example above, PID 29880 is my text editor session where I am writing 
script7. Killing that would not be a good idea:). 


Now for some fun! The next script allows you to draw crude pictures on the screen: 


Chapter 5 - Script 8 


#!/bin/sh 


# 


# 5/16/2017 


# 


echo "Scripts - Linux Scripting Book" 


# Subroutines 


cls () 


{ 
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tput clear 


} 


move () # move cursor to row, col 


{ 


tput cup $1 $2 


} 


movestr () # move cursor to row, col 


{ 


tput cup $1 $2 


echo -n "$3" # display string 

} 

init () # set initial values 
{ 

minrow=1 # terminal boundaries 


maxrow=24 
mincol=0 
maxcol=79 
startrow=1 


startcol=0 


restart () # clears screen, sets initial cursor 
position 

cls 

movestr 0 0 "Arrow keys move cursor. 'x' to draw, 'd' to erase, '+' to 


restart, 'Q' to quit." 
row=Sstartrow 


col=Sstartcol 


draw=0 # default is not drawing 


drawchar="" 


} 
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checktermsize2 () # must be the specified size 
re1=0 # default is no error 
if [[ SLINES -ne $1 || SCOLUMNS -ne $2 ]] ; then 
relat # set return code 
fi 


return $rcl1 


} 


# Code starts here 

if [ "$1" = "--help" ] ; then 

echo "Usage: script7 --help" 

echo " This script shows the basics on how to create a game." 
echo " Use the arrow keys to move the cursor." 

echo " Press c to restart and Q to quit." 

exit 255 

fi 


checktermsize2 25 80 # terminal must be this size 
rc=$? 
if [ Src -ne 0 ] ; then 


echo "Please size the terminal to 25x80 and try again." 


exit 1 

fi 

init # initialize values 

restart # set starting cursor pos and clear screen 
loop=1 


while [ Sloop -eq 1 ] 
do 
move Srow Scol # position the cursor here 


read -n 1 -s ch 


case "Sch" in 
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esac 


done 


echo 


This was fun to write and a bit more fun to play with than I expected it to be. 


if [ $row -gt S$minrow ] ; then 
let row-- 


fi 

if [ Srow -lt Smaxrow ] ; then 
let row++ 

fa 

if [ $col -lt Smaxcol ] ; then 


let col++ 


if [ $col -gt $mincol ] ; then 


let col-- 
fa 
echo -n "" # delete char 


if [ Scol -lt Smaxcol ] ; then 
echo -n "X" # put char 
let col++ 

fi 

restart ;; 


loop=0 ;; 


movestr 24 0 "Script completed normally." 


wn # carriage return 


exit 0 
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One thing we haven't covered yet is the case statement. This is similar to an if... 
then. ..else but makes the code easier to read. Basically, the value that was input 
to the read statement is checked for a match in each case clause. If it matches, that 
stanza is executed and then control goes to the line after the esac statement. It also 
does this if there is no match. 


Try this script, and remember to make the terminal 25x80 (or 80x25 if that is how 
your GUI works). 


Here is just one example of what can be done with this script: 


guesti@big1:~/LinuxScriptingBook/chapters/chap5 
File Edit View Search Terminal Help 
Arrow keys move cursor. 'x' to draw, ‘d' to erase, '+' to restart, 'Q' to quit. ~ 


XXXXXXXXXXXXXXXXXXXXXXXXAXXXAXXAKXAKKK 
X 


X 
XX XXXXXXXXXXXXXXXXXXXXXXXAXXXXXXXXXAXK 
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXKAN X X 
XXXXXXXXXXXXXXXXXXXXXXXAKXXXXAKXXXAAKKKK X X 
XXXX X X 
X X 


X 

X 
X X X 

XXXXXXXXXXXXXXXXX 


X 

X X 

X X 
XXXXXXXXXXXXXXXX 








Well okay I guess this shows that I am not much of an artist. I will stick to 
programming and writing books. 


Summary 


In this chapter we showed how to use the read built-in command to query the 
keyboard. We explained some of the different options to read and also covered the 
use of traps. A simple drawing game was also included. 


The next chapter will show how to automate a script so that it can run unattended. 
We will explain how cron can be used to run the script at a specific time. The 
archival programs zip and tar will also be covered as they are very useful when 
creating automated back up scripts. 
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This chapter shows how to automate various tasks using scripts. 
The topics covered in this chapter are as follows: 


* How to create a script to automate a task. 
¢ The proper way to use cron to run the script automatically at specific times. 
¢ How to use ZIP and TAR to perform compressed backups. 


¢ Source code examples. 
The reader will learn how to create automated scripts. 


We talked about the sleep command in Chapter 3, Using Loops and the sleep Command. 
It can be used to create an automated script (that is, one that runs at a specific time 
with no user intervention) as long as a few guidelines are followed. 


This very simple script will reinforce what we covered in Chapter 3 Using Loops and 
the sleep Command about using the sleep command for automation: 


Chapter 6 - Script 1 


#!/bin/sh 

# 

# 5/23/2017 

# 

echo "Sscriptl - Linux Scripting Book" 


while [ true ] 
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do 
date 
sleep 1d 
done 
echo "End of script1" 


exit 0 


If you run this on your system and wait a few days you will start to see the date slip 
a little. This is because the sleep command inserts a delay into the script, it does not 
mean that it is going to run the script at the same time every day. 


S, "The following script shows this problem in a bit more detail. 
Xs Note that this is an example of what not to do. 


Chapter 6 - Script 2 
#!/bin/sh 
# 
# 5/23/2017 
# 
echo "Script2 - Linux Scripting Book" 
while [ true ] 
do 
# Run at 3 am 
date | grep -q 03:00: 
rc=$? 
if [ $rce -eq 0] ; then 
echo "Run commands here." 
date 
fi 
sleep 60 # sleep 60 seconds 
done 
echo "End of script2" 


exit 0 
The first thing you will notice is that this script will run until it is either manually 


terminated with Ctrl + C or the kill command (or when the machine goes down for 
whatever reason). It is common for automated scripts to just run forever. 
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The date command, as run without any parameters, returns something like this: 


guestl1 $ date 
Fri May 19 15:11:54 HST 2017 


So now all we have to do is use grep to match that time. Unfortunately, there is a 
very subtle problem here. It has been verified that it is possible for this to miss from 
time to time. For example, if the time has just changed to 3:00 am and the program 
is now in the sleep it might already be 3:01 when it wakes up. In my early days in 
computing I had seen code like this all the time in my jobs and never gave it a single 
thought. When some important backups were missed one day my team was asked 
to figure out what was going on and we discovered this issue. A quick fix for this 
would be to change the seconds to 59, however, a better way is to use cron which 
will be shown later in this chapter. 


Notice the -g option to grep, this simply tells it to suppress any output. Feel free to 
take this out if you want, especially when first writing the script. Also notice that 
grep returns 0 when a match is found, non-zero otherwise. 


With all this said let's look at some simple automated scripts. I have been running 
the following on my Linux systems since 1996: 


Chapter 6 - Script 3 
#!/bin/sh 
# 
# 5/23/2017 
# 
echo "script3 - Linux Scripting Book" 
FN=/tmp/log1.txt # log file 
while [ true ] 
do 
echo Pinging $PROVIDER 
ping -c 1 $PROVIDER 
rce=$? 
if [ Src -ne 0 ] ; then 
echo Cannot ping $PROVIDER 
date >> SFN 
echo Cannot ping $PROVIDER >> SFN 
fi 
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sleep 60 
done 
echo "End of script3" # 60 seconds 


exit 0 


And the output on my system: 











guesti@big1i:~/LinuxScriptingBook/chapters/chapo 
File Edit View Search Terminal Help 


guestl ~/LinuxScriptingBook/chapters/chap6 $ script3 
script3 - Linux Scripting Book 

Pinging twc.com 

PING twc.com (71.74.183.9) 56(84) bytes of data. 

64 bytes from 71.74.183.9: icmp _seq=1 ttl=50 time=119 ms 


--- twc.com ping statistics --- 

1 packets transmitted, 1 received, 0% packet loss, time 128ms 
rtt min/avg/max/mdev = 119.551/119.551/119.551/0.000 ms 
Pinging twc.com 

PING twc.com (71.74.183.9) 56(84) bytes of data. 

64 bytes from 71.74.183.9: icmp _seq=1 ttl=50 time=119 ms 


--- twc.com ping statistics --- 

1 packets transmitted, 1 received, 0% packet loss, time 248ms 
rtt min/avg/max/mdev = 119.106/119.106/119.106/0.000 ms 
Pinging twc.com 

PING twc.com (71.74.183.9) 56(84) bytes of data. 

64 bytes from 71.74.183.9: icmp _seq=1 ttl=50 time=119 ms 


--- twc.com ping statistics --- 

1 packets transmitted, 1 received, 0% packet loss, time 211ms 
rtt min/avg/max/mdev = 119.979/119.979/119.979/0.000 ms 
Pinging twc.com 

PING twc.com (71.74.183.9) 56(84) bytes of data. 

64 bytes from 71.74.183.9: icmp _seq=1 ttl=50 time=120 ms 

i & 





guestl ~/LinuxScriptingBook/chapters/chap6 $ | | 


I ran it just three times, however, it would go forever. Before running this on your 
system let's talk about that PROVIDER environment variable. I have several scripts 

on my system that deal with the Internet and I found myself constantly changing 

providers. It didn't take too long to realize that this was a great time to use an env 
var, hence PROVIDER. 


This isin my /root/.bashre and /home/guest1/.bashrc files: 


export PROVIDER=twc.com 
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Substitute yours as needed. Notice too that when a failure occurs it is being written 
to the screen and to a file. Since the >> append operator is being used the file might 
eventually get rather large so plan accordingly if your connection is not very stable. 


my! Be careful they you do not ping or otherwise access a company 
Q site too many times in a short time frame. This could be 
detected and your access might be denied. 


Here is a script that detects when a user has either logged on or off your system: 


Chapter 6 - Script 4 
#!/bin/sh 
# 
# 5/23/2017 
# 
echo "Chapter 6 - Script 4" 
numusers=~who | we -17 
while [ true ] 
do 
currusers=~who | we -1> # get current number of users 


if [ $currusers -gt Snumusers ] ; then 


date 
who 
# beep 

numusers=Scurrusers 

elif [ S$currusers -lt Snumusers ] ; then 
echo "Someone logged off." 
date 
numusers=Scurrusers 

fi 

sleep 1 # sleep 1 second 


done 
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Here's the output (adjusted for length): 


Guesti@bigi:~/LinuxscriptingBook/chapters/chapo j |] x! 
File Edit View Search Terminal Help 


guestl ~/LinuxScriptingBook/chapters/chap6 $ script4 
Chapter 6 - Script 4 


Sat May 27 17:45:14 HST 2017 
ttyl 2017-01-12 
pts/0 2017-01-12 
pts/1 2017-01-12 
pts/2 2017-01-12 
pts/3 2017-01-12 
pts/4 2017-01-12 
pts/5 2017-01-12 
pts/6 2017-01-15 
pts/7 2017-01-15 
pts/8 2017-01-17 
pts/9 2017-02-10 
pts/10 2017-01-12 

Someone logged off. 

Sat May 27 17:45:31 HST 2017 


70. 
0. 
:0. 
:0. 
70. 
:0. 
0. 
:0. 
:0. 
:0. 
:0. 





guestl ~/LinuxScriptingBook/chapters/chap6 $ | | 


This script checks the output from the who command to see if it has changed since 
the last run. If so it takes the appropriate action. If you have a beep command or 
equivalent on your system this is a good place to use it. 


Take a look at this statement: 


currusers=~who | we -1~ # get current number of users 


This needs some clarification as we have not covered it yet. Those back-tick 
characters mean to run the command(s) inside and put the result into the variable. In 
this case, the who command is piped into the wc -1 command to count the number 
of lines. This value is then put into the currusers variable. If this sounds a bit 
complicated don't worry, it will be covered in greater detail in the next chapter. 


The remainder of the script should already be clear as we have covered this before. 
If you decide to run something like this on your system just remember that it will 
trigger every time a new terminal is opened. 


Cron 


Okay, now for some real fun. If you have been using Linux for even just a short 
amount of time you are probably already aware of cron. This is a daemon, or 
background process, that executes commands at specific times. 
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Cron reads a file called crontab once a minute to determine if a command needs to 
be run. 


For the examples in this chapter we will focus on the crontab for a guest account 
only (not for root). 


Using my guest1 account here is what it would look like the first time it is run. It 
would be a good idea to follow along on your system under a guest account: 


guest1 $ crontab -1 
no crontab for guestl 


guestl1 $ 


That makes sense as we have not created a crontab file for guest1 yet. It is not 
meant to be edited directly and so the crontab -e command is used. 


Run crontab -e under a guest account on your system now. 


Here is a screenshot of how it appears on my system when using vi: 


guesti@laptop1:/home/guesti 
File Edit View Search Terminal Help 








"/tmp/crontab.c4sprO" OL, OC 
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As you can see the crontab command creates a temporary file. It is unfortunate that 
this file comes up empty as they should have provided a template. Let's add one 
now. Copy and paste the following text into the file: 


# this is the crontab file for guest1l 


# min hour day of month month day of week command 

# 0-59 0-23 1-38 1-12 0-6 

# Sun=0 Mon=1 Tue=2 Wed=3 Thu=4 Fri=5 
Sat=6 


Substitute guest 1 for your user name. This now gives us an idea of what goes 
where. 


To this file add the following line: 
* * * * * date > /dev/pts/31 


The * means to match everything in the field. So in essence this line will fire once a 
minute. 


Weare using the redirection operator to write the output from the echo command to 
another terminal. Substitute yours as appropriate. 


Try the above on your system. Remember you must save the file first, and you 
should see this output: 


guestl $ crontab -e 
crontab: installing new crontab 


guestl §$ 


This means the addition was successful. Now wait for the next minute to come 
around. You should see the current date show up in the other terminal. 


We can now see the basics of cron. Here are a few quick pointers: 


0 0 * * * command # run every day at midnight 

0 3 * * * command # run every day at 3 am 

30 9 1 * * command # run at 9:30 am on the first of 
the month 

45 14 * * 0 command # run at 2:45 pm on Sundays 

0 0 25 12 * command # run at midnight on my birthday 


This is just a very small subset of how the date and times can be set in cron. For more 
information consult the man pages for cron and crontab. 
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One thing that needs to be mentioned is the PATH for a user's cron. It does not source 
the user's .bashrc file. You can verify this by adding the following line: 


* * * * * echo $PATH > /dev/pts/31 # check the PATH 
On my CentOS 6.8 system it shows: 

/usr/bin:/bin 

To get around this problem you can source your .bashrc file: 


* * * * * source $HOME/.bashrc; echo SPATH > /dev/pts/31 
# check the PATH 


This should now show the real path. The EDITOR env var was mentioned in Chapter 
2, Working with Variables. If you want crontab to use a different text editor you can 
set EDITOR to the path/name of the one you want. 


For example, on my system I have this: 


export EDITOR=/home/guest1/bin/kw 
So when Irun crontab -e I get this: 


guesti@big1i:~/LinuxScriptingBook 
File Edit View Search Terminal Help 


---- Top of file ---- 
# this is the crontab file for guestl 


# min hour day of month month day of week command 
# 0-59 0-23 1-31 1-12 0-6 Sun=0 
Ht Sun=0 Mon=1 Tue=2 Wed=3 Thu=4 Fri=5 Sat=6 
TTY=/dev/pts/31 
* * source $HOME/.bashrc; echo $PATH > $TTY 


* 4 /home/guest1/bin/which-can # Thursday at 6 pm 


---- Bottom of file ---- 


Mon May 22 2:59pm === 
1 NEW 13 








Lewis Linux Editor 5/5/2017 /tmp/crontab.7pfqyD 
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Another thing that should be mentioned is if you make a mistake when using 
crontab in some cases it will tell you when you attempt to save the file. But it cannot 
check everything so be careful. Also, if a command gets an error crontab will use the 
mail system to notify the user. So, with this in mind you may need to run the mail 
command from time to time when using cron. 


Now that we have looked at the basics let's create a backup script that uses the zip 
command. If you are not familiar with zip don't worry, this will get you up to speed 
quickly. On a Linux system most people just use the tar command, however, if you 
know how zip works you can share files with Windows users more easily. 


In a directory under a guest account run these commands on your system. As usual I 
used /home/guest1/LinuxScript ingBook: 


Make a work directory: 


guest1l ~/LinuxScriptingBook $ mkdir work 


Change to it: 


guest1 ~/LinuxScriptingBook $ cd work 


Create some temporary files, and/or copy a few existing files to this directory: 


guest1 ~/LinuxScriptingBook/work $ route > route.txt 
guest1 ~/LinuxScriptingBook/work §$ ifconfig > ifconfig.txt 
guest1 ~/LinuxScriptingBook/work $ ls -la /usr > usr.txt 


guest1 ~/LinuxScriptingBook/work $ cp /etc/motd 
Get a listing: 


guest1 ~/LinuxScriptingBook/work $ ls -la 
total 24 

drwxrwxr-x 2 guestl guestl 4096 May 23 09:44 
drwxr-xr-x guestl guestl 4096 May 22 15:18 
-rw-rw-r-- guest1l guest1 1732 May 23 09:44 ifconfig.txt 


-rw-rw-r-- guestl guestl 335 May 23 09:44 route.txt 











8 
al 
-rw-r--r-- 1 guestl guestl 1227 May 23 09:44 motd 
lt 
al 


-rw-rw-r-- guestl guestl 724 May 23 09:44 usr.txt 
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Zip them up: 
guest1l ~/LinuxScriptingBook/work $ zip workl.zip * 
adding: ifconfig.txt (deflated 69%) 
adding: motd (deflated 49%) 
adding: route.txt (deflated 52%) 
adding: usr.txt (deflated 66%) 


Get another listing: 


guest1 ~/LinuxScriptingBook/work $ ls -la 
total 28 

drwxrwxr-x 2 guestl guestl 4096 May 23 09:45 
drwxr-xr-x guestl guestl 4096 May 22 15:18 
-rw-rw-r-- guest1l guest1 1732 May 23 09:44 ifconfig.txt 


-rw-Yr--r-- guestl guest1l 1227 May 23 09:44 motd 





-rw-rw-r-- guestl guestl 724 May 23 09:44 usr.txt 








8 
1 
lt 
-rw-rw-r-- 1 guestl guestl 335 May 23 09:44 route.txt 
1 
1 


-rw-Lrw-r-- guest1l guest1l 2172 May 23 09:45 workl.zip 

There is now file work1.zip in that directory. The syntax to create a zip file is: 
zip [optional parameters] filename.zip list-of-files-to-include 

To unzip it: 
unzip filename.zip 

To view (or list) the contents of a zip file without extracting it: 


unzip -1 filename.zip 


This is also a good way to ensure that the . zip file was created properly, because 
unzip will report an error if it cannot read the file. Note that the zip command 
not only creates a . zip file but it also compresses the data. This makes for smaller 
backup files. 
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Here's a short script that uses zip to back up some files: 


Chapter 6 - Script 5 
#!/bin/sh 

# 

# 5/23/2017 

# 

echo "Sscript5 - Linux Scripting Book" 
FN=workl1.zip 

cd /tmp 


mkdir work 2> /dev/null # suppress message if directory already 


exists 

cd work 

cp /etc/motd . 

cp /etc/issue . 

ls -la /tmp > tmp.txt 

ls -la /usr > usr.txt 

rm SFN 2> /dev/null # remove any previous file 
zip $FN * 

echo File "SFN" created. 

# cp to an external drive, and/or scp to another computer 
echo "End of script5" 


exit 0 


And the output on my system: 


guesti@bigi:~/LinuxScriptingBook/chapters/chap6 
File Edit View Search Terminal Help 


guestl ~/LinuxScriptingBook/chapters/chap6 $ script5 
i Linux Scripting Book 
issue (stored 0%) 
motd (deflated 49%) 
tmp.txt (deflated 66%) 
usr.txt (deflated 66%) 
File workl.zip created. 
End of script5 
guestl ~/LinuxScriptingBook/chapters/chap6 $ [] 


Pilsikd 
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This is a really simple script, however it shows the basics of using the zip command 
to backup some files. 


Suppose we wanted to run this every day at midnight. Assuming script5 was 
located under /tmp, the crontab entry would be the following: 


guest1 /tmp/work $ crontab -1 


# this is the crontab file for guestl 


# min hour day of month month day of week command 

# 0-59 0-23 1 =3 1: t= 2 0-6 Sun=0 

# Sun=0 Mon=1 Tue=2 Wed=3 Thu=4 Fri=5 
Sat=6 


00* * * /tmp/scripts 


In this case we did not have to source the /home/guest1/.bashrc file. Also notice 
that any errors get sent to the User's mail account. The zip command can do a 
whole lot more than just this, for example it can recurse into directories. For more 
information consult the man pages. 


Now let's talk about the Linux tar command. It is used more frequently than the zip 
command and is better at getting all files, even hidden ones. Referring back to the / 
tmp/work directory, here is how you would use tar to back it up. It is assumed 
the files are still there from the previous script: 


guestl /tmp $ tar cvzf workl.gz work/ 
work/ 

work/motd 

work/tmp.txt 

work/issue 

work/work1.zip 

work/usr.txt 


guest1 /tmp $ 
There is now file work1.gz under the /tmp directory. It is a compressed archive 


of the contents of all the files under /tmp/work, including the . zip file we created 
earlier. 
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The syntax for tar is a little cryptic at first but you will get used to it. Some of the 
features available in tar are: 


























Parameter Feature 

c create an archive 

x extract an archive 

v use the verbose option 

Zz use gunzip style compression (.gz) 
£ the filename to create/ extract 





Note that if you do not include the z option the file will not be compressed. By 
convention the file extension would then just be tar. Note that the user controls the 
actual name of the file, not the tar command. 


Okay so now we have a compressed tar-gz file (or archive). Here is how to un- 
compress and extract the files. We will do this under /home/guest1: 

guest1 /home/guestl1 $ tar xvzf /tmp/workl.gz 

work/ 

work/motd 

work/tmp.txt 

work/issue 

work/work1.zip 

work/usr.txt 


guest1 /home/guestl1 §$ 


Using tar to backup a system is really convenient. It's also a great way to configure a 
new machine with your personal files. For example, I routinely back up the following 
directories on my primary system: 

/home/guest1 

/lewis 

/temp 


/root 


These files are then auto-copied to an external USB drive. Remember that tar 
automatically recurses into directories and also gets every file, including hidden 
ones. Tar also has many other options that control how the archive is created. 
One of the most common options is to exclude certain directories. 


For example, when backing up /home/guest1 there is really no reason to include the 
. cache, Cache, . thumbnails, and so on directories. 
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The option to exclude directories is --exclude=<directory name> and that is 
shown in the next script. 


Here are the backup programs that I use on my primary Linux system. It is two 
scripts, one to schedule the backup and one to actually perform the work. I mainly 
did this so that I could make changes to the actual backup script without turning off 
the scheduler script. The first thing that needs to be set up is the crontab entry. Here 
is what it looks like on my system: 


guestl1 $ crontab -1l 


# this is the crontab file for guestl 


# min hour day of month month day of week command 

# 0-59 0-23 123 T=12 0-6 Sun=0 

# Sun=0 Mon=1 Tue=2 Wed=3 Thu=4 Fri=5 
Sat=6 


TTY=/dev/pts/31 


0 3 * * * touch /tmp/runbackup-cron.txt 
This will create the file /tmp/backup-cron.txt at approximately 3 am every day. 


Note that the following scripts must be run as root: 


Chapter 6 - Script 6 

#!/bin/sh 

# 

# runbackupl - this version watches for file from crontab 
# 

# 6/3/2017 - mainlogs now under /data/mainlogs 

# 

VER="runbackupl1 6/4/2017 A" 

FN=/tmp/runbackup-cron.txt 


DR=/wd1 # symbolic link to external drive 


tput clear 
echo SVER 


# Insure backup drive is mounted 
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file $DR | grep broken 
rc=$? 


if [ Src -eq 0 ] ; then 


beep 
exit 255 
fi 


cd $LDIR/backup 


while [ true ] 
do 


# crontab creates the file at 3 am 


if [ -£ SFN ] ; then 
rm SFN 

echo Running backup1l 
backupl | tee /data/mainlogs/mainlog*date '+%Y%m%d'~.txt 
echo S$SVER 
fi 


sleep 60 # check every minute 


done 


There's a lot of information here so we will go through it line by line: 


¢ The script first sets up the variables, clears the screen, and displays the name 


of the script. 


¢ The DR variable is assigned to my USB external drive (wd1) which is a 


symbolic link. 


¢ Acheck is then performed using the £ile command to ensure that /wd1 has 
been mounted. If it has not, the £ile command will return broken symbolic 


link, grep will trigger on this, and the script will abort. 


¢ If the drive is mounted then the loop is entered. The existence of the file is 


checked every minute to see if it is time to begin the backup. 
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¢ When the file is found the backup1 script (see next) is run. The output from it 
is sent to both the screen and the file using the tee command. 


¢ The date format specifier '+%y%m%d' shows the date in this format: 
YYYYMMDD 


I check the files in the /data/mainlogs directory from time to time to make sure my 
backups are being created correctly with no errors. 


The following script is used to backup my system. The logic here is the current 
day backups are stored on the hard drive in the $TDIR directory. They are also 
copied to a numbered directory on the external drive. These go into directories 
numbered 1 through 7. When the last one is reached it starts back at 1 again. This 
way there are always 7 days of backups available on the external drive. 


This script must also be run as root: 


Chapter 6 - Script 7 
#!/bin/sh 
# Jim's backup program 
# Runs standalone 
# Copies to /data/backups first, then to USB backup drive 
VER="File backup by Jim Lewis 5/27/2017 A" 
TDIR=/data/backups 
RUNDIR=SLDIR/backup 
DR=/wd1 
echo SVER 
cd SRUNDIR 
# Insure backup drive is mounted 
file SDR | grep broken 
a=$? 
if [— "Sa" != "1" ] ; then 
echo "ERROR: USB drive SDR is not mounted! !!!J!!!rrrrrrun 
beep 
exit 255 
fi 
date >> datelog.txt 
date 


echo "Removing files from $TDIR" 
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cd "STDIR" 
rc=$? 
if [ Src -ne 0 ] ; then 


echo "backup1: Error cannot change to $TDIR!" 


exit 250 
fi 
rm *.gz 


echo "Backing up files to $TDIR" 
X="date '+%Y%m%d'~ 

cd / 

tar cvzfi "STDIR/lewissxX.gz" lewis 











tar cvzf "STDIR/temp$xX.gz" temp 

tar cvzf "S$TDIR/root$xX.gz" root 

cd /home 

tar cvzf "STDIR/guest$X.gz" --exclude=Cache --exclude=.cache --exclude=. 
evolution --exclude=vmware --exclude=.thumbnails --exclude=.gconf 
--exclude=.kde --exclude=.adobe --exclude=.mozilla --exclude=. 

gconf --exclude=thunderbird --exclude=.local --exclude=.macromedia 
--exclude=.config guest1l 

cd SRUNDIR 


T="cat filenum1~ 
BACKDIR=SDR/backups/$T 
rm $BACKDIR/*.gz 

cd "STDIR" 

cp *.gz SBACKDIR 

echo $VER 

cd SBACKDIR 


pwd 

ls -lah 

cd SRUNDIR 

let T++ 

if [ $T -gt 7] ; then 
T=1 

fi 


echo $T > filenuml 
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This is a bit more complicated than the previous scripts so let's go through it line 


by line: 


The RUNDIR variable holds the starting directory for the scripts. 
The bDR variable points to the external backup drive. 

The drive is checked to insure it is mounted. 

The current date is appended to the datelog.txt file. 

The TDIR variable is the target directory for the backups. 


A cd is performed to that directory and the return code is checked. On error 
the script exits with a 250. 


The backups from the previous day are deleted. 


It now goes back to the / directory to perform the tar backups. 


Notice that several directories are excluded from the guest1 directory. 


The cd $RUNDIR puts it back into the starting directory. 


The T=~£ilenum1~ gets the value from that file and puts it into the T 
variable. This is a counter for which directory to use next on the external 
drive. 


BACKDIR is set to the old backups and then they are removed. 


Control returns again to the starting directory, and the current backups are 
copied to the appropriate directory on the external drive. 


The version of the program is displayed again so that it can be easily found 
on a cluttered screen. 


Control goes to the backup directory, the pwd displays the name, and then 
the contents of the directory are displayed. 


The T variable is incremented by 1. If it is greater than 7 it is set back to 1. 


And finally the updated T variable is written back to the filenum1 file. 


This script should serve as a good starting point for whatever backup process you 
want to develop. Note that the scp command can be used to copy files directly to 
another computer without user intervention. This will be covered in Chapter 10, 
Scripting Best Practices. 
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Summary 


We described how to create a script to automate a task. The proper way to use cron 
to run a script automatically at a specific time was covered. The archive commands 
zip and tar were discussed to show how to perform compressed backups. A full 
scheduler and backup script were also included and discussed. 


In the next chapter we will show how to read and write files in a script. 
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This chapter will show how to read from and write to text files. It will also cover file 
encryption and checksums. 


The topics covered in this chapter are as follows: 


Show how to write out a file using the redirection operator 
Show how to read a file 


Explain how the output from a command can be captured and used in 
a script 


Go over cat and other important commands 


Cover file encryption and checksum programs such as sum and OpenSSL 


Writing files 

We showed in some of the previous chapters how to create and write files by using 
the redirection operator. To recap, this command will create the file ifconfig.txt 
(or overwrite the file if it already exists): 


ifconfig > ifconfig.txt 


The following command will append to any previous file or create a new one if it 
does not already exist: 


ifconfig >> ifconfig.txt 
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Some of the previous scripts used the back-tick operator to retrieve the data froma 
file. Let's recap by looking at Script 1: 


Chapter 7 - Script 1 
#!/bin/sh 

# 

# 6/1/2017 

# 

echo "Chapter 7 - Script 1" 
FN=filel.txt 


rm SFN 2> /dev/null # remove it silently if it exists 
x= 
while [ $x -le 10 ] # 10 lines 
do 
echo "x: $x" 
echo "Line $x" >> SFN # append to file 
let x++ 
done 


echo "End of script1" 


exit 0 


Here is a screenshot: 


guesti@big1:~/LinuxScriptingBook/chapters/chap7 


File Edit View Search Terminal Help 

guestl ~/LinuxScriptingBook/chapters/chap7 $ scriptl 
Chapter 7 - Script 1 

me 


xx KKK KK XK 
FP OMDNODUBWNH 


: 10 
End of scriptl 
guestl ~/LinuxScriptingBook/chapters/chap7 $ cat filel.txt 


x 


10 
guestl ~/LinuxScriptingBook/chapters/chap7 $ [] 
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This is pretty straight forward. It removes the file (silently) if it exists, and then 
outputs each line to the file, incrementing x each time. When x gets to 10 the 
loop terminates. 


Reading files 


Now let's look again at the method the backup scripts in the last chapter used to get 
the value from a file: 


Chapter 7 - Script 2 
#!/bin/sh 

# 

# 6/2/2017 

# 

echo "Chapter 7 - Script 2" 


FN=filenum1.txt # input/output filename 
MAXFILES=5 # maximum number before going back to 1 
if [ ! -£ S$FN ] ; then 

echo 1 > SFN # create the file if it does not exist 
fi 


echo -n "Contents of SFN: " 


cat SFN # display the contents 


count="cat SFN~ # put the output of cat into variable count 


echo "Initial value of count from S$FN: Scount" 


let count++ 


if [ $count -gt S$MAXFILES ] ; then 
count=1 
fi 


echo "New value of count: $count" 
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echo $count > SFN 


echo -n "New contents of SFN: " 


cat SFN 


echo "End of script2" 


exit 0 


Here is the screenshot for Script 2: 











—— 


guesti@big1:~/LinuxScriptingBook/chapters/chap7 
File Edit View Search Terminal Help 


guestl ~/LinuxScriptingBook/chapters/chap7 $ rm filenuml.txt 
guestl ~/LinuxScriptingBook/chapters/chap7 $ script2 

Chapter 7 - Script 2 

Contents of filenuml.txt: 1 

Initial value of count from filenuml.txt: 1 

New value of count: 2 

New contents of filenuml.txt: 2 

End of script2 

guestl ~/LinuxScriptingBook/chapters/chap7 $ script2 

Chapter 7 - Script 2 


Initial value of count from filenuml.txt: 2 

New value of count: 3 

New contents of filenuml.txt: 3 

End of script2 

guestl ~/LinuxScriptingBook/chapters/chap7 $ script2 


Initial value of count from filenuml.txt: 3 

New value of count: 4 

New contents of filenuml.txt: 4 

End of script2 

guestl ~/LinuxScriptingBook/chapters/chap7 $ script2 
Chapter 7 - Script 2 

Contents of filenuml.txt: 4 

Initial value of count from filenuml.txt: 4 

New value of count: 5 

New contents of filenuml.txt: 5 

End of script2 

guestl ~/LinuxScriptingBook/chapters/chap7 $ script2 
Chapter 7 - Script 2 

Contents of filenuml.txt: 5 

Initial value of count from filenuml.txt: 5 

New value of count: 1 

New contents of filenuml.txt: 1 

End of script2 

guestl ~/LinuxScriptingBook/chapters/chap7 $ | | 
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We start by setting the FN variable to the name of the file (filenum1.txt). It is 
displayed by the cat command and then the contents of the file are assigned to the 
count variable. It is displayed and then incremented by 1. The new value is written 
back to the file and then it is displayed again. Run this one at least 6 times to see how 
it wraps around. 


This is just one simple way to create and read a file. Now let's look at a script that 
reads several lines from a file. It will use the file file1.txt that was created by the 
preceding Script 1. 


Chapter 7 - Script 3 
#!/bin/sh 
# 
# 6/1/2017 
# 
echo "Chapter 7 - Script 3" 
FN=filel.txt # filename 
while IFS= read -r linevar # use read to put line into linevar 
do 
echo "Slinevar" # display contents of linevar 
done < SFN # the file to use as input 
echo "End of script3" 


exit 0 
And here is the output: 


guesti@bigi:~/LinuxScriptingBook/chapters/chap7 
File Edit View Search Terminal Help 


End of script3 


guestl ~/LinuxScriptingBook/chapters/chap7 $ [] 
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The structure here may look a little strange as it is rather different from what we 
have seen before. This script uses the read command to get each line of the file. In 
the statement: 


while IFS= read -r linevar 


The IFS= (Internal Field Separator) prevents read from trimming leading and 
trailing whitespace characters. The -r parameter to read causes backslash escape 
sequences to be ignored. The next line uses the redirection operator to enable file1. 
txt as the input for read. 


done < SFN 


There is a lot of new material here and so look this over carefully until you get 
comfortable with it. 


There is a slight flaw in the above script. If the file does not exist an error will occur. 
Look at the following screenshot: 


guesti@big1:~/LinuxScriptingBook/chapters/chap7 
File Edit View Search Terminal Help 


guestl ~/LinuxScriptingBook/chapters/chap7 $ rm filel.txt 
guestl ~/LinuxScriptingBook/chapters/chap7 $ script3 
Chapter 7 - Script 3 


./script3: line 10: filel.txt: No such file or directory 
End of script3 
guestl ~/LinuxScriptingBook/chapters/chap7 $ [] 





Shell scripts are interpreted, meaning each line is examined and run by the system 
one at a time. This is different from say a program written in the C language which 
is compiled. This means any syntax errors will appear during the compile stage and 
not when the program is run. We will discuss how to avoid most shell scripting 
syntax errors in Chapter 9, Debugging scripts. 


Here is Script 4 with a solution to the missing file problem: 


Chapter 7 - Script 4 
rail 

# 6/1/2017 

# 
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echo "Chapter 7 - Script 4" 


FN=filel.txt # filename 


af [4 


-f SFN ] ; then 


echo "File SFN does not exist." 


exit 100 


fi 


while IFS= read -r linevar # use read to put line into linevar 


do 


echo "Slinevar" # display contents of linevar 


done < SFN # the file to use as input 


echo "End of script4" 


exit 0 


And the following is the output: 

















guesti@big1:~/LinuxScriptingBook/chapters/chap7 
File Edit View Search Terminal Help 
guestl ~/LinuxScriptingBook/chapters/chap7 $ script4 
Chapter 7 - Script 4 
File filel.txt does not exist. 
guestl ~/LinuxScriptingBook/chapters/chap7 $ scriptl 
Chapter 7 - Script 1 
bree 


x: 2 
x: 3 
x: 4 
x: 5 
x: 6 
xe 7 
x: 8 
x: 9 

zl 


x: 10 
End of scriptl 
guestl ~/LinuxScriptingBook/chapters/chap7 $ script4 


10 
End of script4 
guestl ~/LinuxScriptingBook/chapters/chap7 $ | | 








[121] 


Working with Files 





Keep this in mind when using files and always check to make sure the file exists 
before trying to read it. 


Reading and writing files 


This next script reads a text file and creates a copy of it: 


Chapter 7 - Script 5 
#!/bin/sh 

# 

# 6/1/2017 

# 

echo "Chapter 7 - Script 5" 


if [| S# -ne 2 ] ; then 
echo "Usage: script5 infile outfile" 


echo " Copies text file infile to outfile." 


exit 255 
fa: 
INFILE=$1 


OUTFILE=$2 





if [ ! -f£ SINFIL! 


Gl 





] ; then 

echo "Error: File SINFILE does not exist." 
exit 100 

fi 


if [ SINFILE = SOUTFILE ] ; then 

echo "Error: Cannot copy to same file." 
exit 101 

fA: 


rm SOUTFILE 2> /dev/null # remove it 
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echo "Reading file SINFILE 


x=0 

while IFS= read -r linevar 

do 
echo "Slinevar" >> SOUTFILE 
let x++ 

done < SINFILE 


echo "$x lines read." 


diff SINFILE SOUTFILE 
rc=$? 


if [ Src -ne 0 ] ; then 


echo "Error, files do not match. 


exit 103 


else 


echo "File SOUTFILE created." 


fi 


sum SINFILE SOUTFILE 


echo "End of script5" 


exit $rec 


use read to put line into linevar 


append to file 


the file to use as input 


use diff to check the output 


W 


# show the checksums 
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Here is the screenshot for Script 5: 


guesti@bigi:~/LinuxScriptingBook/chapters/chap7 
File Edit View Search Terminal Help 


guestl ~/LinuxScriptingBook/chapters/chap7 $ script5 
Chapter 7 - Script 5 
Usage: script5 infile outfile 
Copies text file infile to outfile. 
guestl ~/LinuxScriptingBook/chapters/chap7 $ script5 file2.txt out1.txt 
Chapter 7 - Script 5 
Error: File file2.txt does not exist. 
guestl ~/LinuxScriptingBook/chapters/chap7 $ script5 filel.txt filel.txt 
Chapter 7 - Script 5 
Error: Cannot copy to same file. 
guestl ~/LinuxScriptingBook/chapters/chap7 $ script5 filel.txt out1l.txt 
Chapter 7 - Script 5 
Reading file filel.txt ... 
10 lines read. 
File outl.txt created. 
1 filel.txt 
1 outl.txt 
End of script5 
guestl ~/LinuxScriptingBook/chapters/chap7 $ [] 





This shows how to read and write a text file in a script. The following explains 
each line: 


¢ The script starts by checking if two parameters were given and if not the 
Usage message is displayed. 
¢ It then checks if the input file exists and exits with code 100 if it does not. 


¢ Acheck is made to insure the user is not trying to copy to the same file, 
because a syntax error at line 34 would have occurred. This code insures that 
will not happen. 


¢ The output file is removed if it exists. This is because we want to copy toa 
new file and not append to an existing one. 


¢ The while loop reads and writes the lines. A count is made of the number of 
lines in x. 


¢ When the loops ends the number of lines is output. 


¢ Asa sanity check, the diff command is used to make sure the files are 
the same. 


e And as an added check the sum command is run on the two files. 
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Reading and writing files interactively 


This next script is similar to one in Chapter 5, Creating Interactive Scripts. It reads 
the file specified, displays a form, and allows the user to edit and then save it: 





Chapter 7 - Script 6 
#!/bin/sh 

# 6/2/2017 

# Chapter 7 - Script 6 


trap catchCtrlc INT # Initialize the trap 


# Subroutines 

catchCtr1C() 

{ 

move 13 0 

savefile 

movestr 23 0 "Script terminated by user." 
echo "" # carriage return 


exit 0 


cls () 


{ 


tput clear 


} 


move () # move cursor to row, col 


{ 


tput cup $1 $2 


} 


movestr () # move cursor to row, col 


{ 


tput cup $1 $2 
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echo -n "$3" 


} 


# 


display string 


checktermsize () 

{ 

rce1=0 # default is no error 
if [[ SLINES -1t $1 || SCOLUMNS -1t $2 ]] ; then 
rele=1 # set return code 

fi 


return $rcl1 


} 


init ( 


srow[0]=2; scol 


srow[1]=4;  scol 


srow[2]=6;  scol 
srow[3]=8; scol 
srow[4]=8; scol 
srow[5]=8; scol 








srow[6]=10; scol 


drawscreen () 


{ 


cls 


[0] =7 
[1] =12 
[2] =12 
[3] =7 
[4] =37 
[5] =52 
[6] =8 





+# + + HH H+ H +H 


i 


set up the cursor position array 


name 
address 1 
address 2 
city 
state 
zip code 


email 


main screen draw routine 


clear the screen 


movestr 0 25 "Chapter 7 - Script 6" 


movestr 
movestr 
movestr 
movestr 


movestr 


ooeo an fF WN 
Bw PP PR 


ND oO 


movestr 


"Name: ${array[0] }" 
"Address 1: ${array[1]}" 
"Address 2: ${array[2]}" 
"City: ${array[3]}" 
"State: ${array[4] }" 


"Zip code: ${array[5] }" 
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movestr 10 1 "Email: ${array[6]}" 


while 
do 


{[ true ] 


row=${srow[x]}; col=${scol [x] } 

move Srow S$col 

read var 

if [ -n "Svar" ] then 
array [$x] =Svar 

fi 

let x++ 

if [ $x -eq $sizeofarray ] ; then 

x=0 

fi 


done 


return 0 


} 


savefile() 

{ 

rm SFN 2> /dev/null 

echo "Writing file $FN ..." 
y=0 
while 
do 


[ Sy -lt $sizeofarray ] 


echo "Sy - 'S${array[$y]}'" 
echo "${array[$y]}" >> "SFN" 
let y++ 

done 

echo "File written." 


return 0 


# Start at the first field 


# if not blank assign to array 


# go back to first field 


# remove any existing file 


# display to screen 


# write to file 
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if [ -n "SFN" ] ; then # check that file exists 
while IFS= read -r linevar # use read to put line into linevar 
do 
array [$x] ="$linevar" 
let x++ 
done < SFN # the file to use as input 
fi 
return 0 


} 


# Code starts here 

if [ S# -ne 1] ; then 

echo "Usage: script6é file" 

echo " Reads existing file or creates a new file" 
echo " and allows user to enter data into fields." 


echo " Press Ctrl-C to end." 


exit 255 

fi 

FN=$1 # filename (input and output) 
sizeofarray=7 # number of array elements 


checktermsize 25 80 
rc=$? 
if [| Src -ne 0 ] ; then 


echo "Please size the terminal to 25x80 and try again." 


exit 1 

fi 

init # initialize the screen array 
getfile # read in file if it exists 
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drawscreen # draw the screen 
getdata # read in the data and put into the fields 
exit 0 


Here is what this looks like on my system: 

















guesti@big1:~/LinuxScriptingBook/chapters/chap7 
File Edit View Search Terminal Help 
Chapter 7 - Script 6 


Name: James Kent Lewis 
Address 1: 12-3456 Some street 


Address 2: Apt A *C 


City: Pearl City State: HI Zip code: 


Email: jim@jklewis.com 


Writing file jiml.txt ... 
© - 'James Kent Lewis' 

1 "12-3456 Some street' 
2 ‘Apt A' 

3 ‘Pearl City' 

4 "HI' 

5 '96782' 

6 - 'jim@jklewis.com' 
File written. 


Script terminated by user. 
guestl ~/LinuxScriptingBook/chapters/chap7 $ | | 


Here is a description of the code: 


The first thing that gets set up in this script is a trap of Ctrl + C which causes 
the file to be saved and the script to end. 


The subroutines are defined. 

The getdata routine is used to read the user input. 

The savefile routine writes out the data array. 

The get file routine reads the file, if it exists, into the array. 
The parameters are checked as one filename is required. 
The EN variable is set to the name of the file. 


When using arrays it's a good idea to have a set size, that is, sizeofarray. 
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The size of the terminal is checked to make sure it is 25x80 (or 80x25 
depending on your GUI). 


The init routine is called which sets up the screen array. 
The routines get file and drawscreen are called. 


The get data routine is used to move the cursor and get the data from the 
fields into the proper array location. 


Ctrl + Cis used to save the file and terminate the script. 


This is an example of how a simple screen input/output routine can be developed in 
Bash. This script could use a few refinements, here is a partial list: 


Check an existing file for a specific header. This could help insure the file is 
in the correct format and avoid a syntax error. 

Check the input file to make sure it is text and not binary. Hint: Use the file 
and grep commands. 

If the file cannot be written out properly make sure to catch the error 
gracefully. 


File checksums 

You probably noticed the use of the sum command above. It displays the checksum 
and block count of files which can be used to determine if two or more files are the 
same file (that is, have the exact same contents). 


Here is a real world example: 


Suppose you are writing a book, and the files are being sent from the author to the 
publisher for review. The publisher makes some revisions and then sends the revised 
file back to the author. It is sometimes easy to get out of sync, and receive a file that 
doesn't look any different. If you run the sum command against the two files you can 
easily determine if they are the same. 
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Take a look at the following screenshot: 


guesti@big1i:~/LinuxScriptingBook/chapters/chap7 


File Edit View Search Terminal Help 


guestl ~/LinuxScriptingBook/chapters/chap7 $ sum bookfile* 
84 bookfilel.txt 
84 bookfile2.txt 
84 bookfile3.txt 
84 bookfile4.txt 
84 bookfile5.txt 
84 bookfile6.txt 
75 bookfile7.txt 
576 bookfile8.txt 
guestl ~/LinuxScriptingBook/chapters/chap7 $ [] 








The first column is the checksum and the second column is the block count. If both 
of these are the same that means the contents of the files are identical. So, in this 
example bookfiles 1, 2, and 4 are the same. Bookfiles 3 and 5 are also the same. 
However, bookfiles 6, 7, and 8 don't match up with anything, and the last two don't 
even have the same block count. 


r Note: The sum command only looks at the contents and block 
oT count of the files. It does not look at the filename or other file 
Q attributes such as ownership or permissions. To do that you 
could use the 1s and stat commands. 


File encryption 


There are times you might want to encrypt some important and/or confidential files 
on your system. Some people store their passwords ina file on their computers, this 
is probably okay but only if some type of file encryption is being used. There are 
many encryption programs available, here we will show OpenSSL. 


The OpenSSL command line tool is very popular and is most likely already installed 
on your computer (it came by default on my CentOS 6.8 systems). It has several 
options and methods of encryption, however we will cover just the basics. 
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Using file1.txt again from above try the following on your system: 


guesti@big1:~/LinuxScriptingBook/chapters/chap7 
File Edit View Search Terminal Help 


guestl $ sum filel.txt 

04894 1 

guestl $ openssl enc -aes-256-cbc -in filel.txt -out filel.out 
enter aes-256-cbc encryption password: 

Verifying - enter aes-256-cbc encryption password: 

guestl $ ls -la filel.out 

-rw-rw-r-- 1 guestl guestl 96 Jun 2 18:21 filel.out 

guestl $ openssl enc -aes-256-cbc -d -in filel.out -out file2.txt 
enter aes-256-cbc decryption password: 

guestl $ sum file2.txt 

04894 1 


guestl $ cat file2.txt 
Line 1 





We start by performing a sum on the file1.txt file, then run openssl. Here is 
the syntax: 

* enc: specify which encoding to use, in this case it's aes-256-cbc 

° -in: the input file 

* -out: the output file 

°  -d: decrypt 


After running the openss1 command we perform an 1s -1a to verify that the output 
file was indeed created. 


We then decrypt the file. Note the order of the files and the addition of the -d 
parameter (to decrypt). We do another sum to verify that the resulting file is the 
same as the original. 
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Since there is no way I am going to type that all the time let's write a quick script to 
do it: 


Chapter 7 - Script 7 
#!/bin/sh 

# 

# 6/2/2017 

# 

echo "Chapter 7 - Script 7" 


if [ S# -ne 3 ] ; then 
echo "Usage: script7 -e|-d infile outfile" 


echo " Uses openssl to encrypt files." 


echo " -e to encrypt" 
echo " -d to decrypt" 
exit 255 

fi 

PARM=$1 

INFILE=$2 

OUTFILE=$3 

if [ ! -f£ SINFILE ] ; then 


echo "Input file SINFILE does not exist." 


exit 100 
fi 
if [ "SPARM" = "-e" ] ; then 


echo "Encrypting" 

openssl enc -aes-256-cbc -in SINFILE -out SOUTFILE 
elif [ "SPARM" = "-d" ] ; then 

echo "Decrypting" 

openssl enc -aes-256-cbc -d -in SINFILE -out SOUTFILE 


else 
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echo "Please specify either -e or -d." 
exit 101 
fi 


ls -la SOUTFILE 


echo "End of script7" 


exit 0 


Here is the screenshot: 











guesti@big1:~/LinuxScriptingBook/chapters/chap7 
File Edit View Search Terminal Help 


enter aes-256-cbc encryption password: 

Verifying - enter aes-256-cbc encryption password: 
-rw-rw-r-- 1 guestl guestl 96 Jun 2 19:20 filel.out 
End of script7 

guestl $ script7 -d filel.out file2.txt 

Chapter 7 - Script 7 

Decrypting 

enter aes-256-cbc decryption password: 

-rw-rw-r-- 1 guestl guestl 71 Jun 2 19:20 file2.txt 
End of script7 

guestl $ sum file2.txt 

04894 1 

guestl $ [] 





This is obviously a lot easier than typing (or trying to remember) the syntax for 
openssl. As you can see the resulting decrypted file (£ile2.txt) is the same as the 
file1.txt file. 
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Summary 


In this chapter we showed how to write out a file using the redirection operator 
and how to read a file using the (properly formatted) read command. Converting 
the contents of a file into a variable was covered as was the use of checksums and 
file encryption. 


In the next chapter we will look at some utilities that can be used to gather 
information from web pages on the Internet. 
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This chapter will show how to use wget and cur1 to gather information directly 
from the internet. 


The topics covered in this chapter are: 


* Show how to get information using wget. 


* Show how to get information using curl. 


Scripts that can gather data in this way can be very powerful tools to have at your 
disposal. As you will see from this chapter, you can get stock quotes, lake levels, just 
about anything automatically from web sites anywhere in the world. 


Introducing the wget program 


You may have already heard about or even used the wget program. It is a command 
line utility that can be used to download files from the Internet. 


Here is a screenshot showing wget in its most simplest form: 


guesti@big1:~/LinuxScriptingBook/chapters/chaps 
File Edit View Search Terminal Help 
guestl ~/LinuxScriptingBook/chapters/chap8 $ wget http://jklewis.com 
--2017-06-03 16:43:46-- http://jklewis.com/ 
Resolving jklewis.com... 66.96.149.17 
Connecting to jklewis.com|66.96.149.17|:80... connected. 
HTTP request sent, awaiting response... 200 OK 
Length: 1560 (1.5K) [text/html] 
Saving to: “index.html” 


>] 1,560 --.-K/s in Os 


2017-06-03 16:43:46 (188 MB/s) - “index.html” saved [1560/1560] 


guest1 ~/LinuxScriptingBook/chapters/chaps $ Jj 
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wget options 
In the output you can see that wget downloaded the index.htm1 file from my 
jklewis.com website. 


This is the default behavior of wget. The standard usage is: 
wget [options] URL 
where URL stands for Uniform Resource Locator, or address of the website. 


Here is just a short list of the many available options with wget: 























Parameter Explanation 

-O log file, messages will be written here instead of to STDOUT 
-a same as -o excepts it appends to the log file 

-O output file, copy the file to this name 

-d turn debugging on 

“q quiet mode 

-v verbose mode 

-r recursive mode 














Let's try another example: 


guesti@big1:~/LinuxScriptingBook/chapters/chaps 
File Edit View Search Terminal Help 


guestl ~/LinuxScriptingBook/chapters/chap8 $ wget -o logl.txt http://jklewis.com 
guestl ~/LinuxScriptingBook/chapters/chap8 $ echo $? 

0 
guestl ~/LinuxScriptingBook/chapters/chap8 $ cat logl.txt 
--2017-06-05 12:37:10-- http://jklewis.com/ 

Resolving jklewis.com... 66.96.149.17 

Connecting to jklewis.com|66.96.149.17|:80... connected. 
HTTP request sent, awaiting response... 200 OK 

Length: 1560 (1.5K) [text/html] 

Saving to: “index.html.1” 


OK . 100% 191M=0s 


2017-06-05 12:37:10 (191 MB/s) - “index.html.1” saved [1560/1560] 


guestl ~/LinuxScriptingBook/chapters/chap8 $ Jj 








a 
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The -o option was used in this case. The return code was checked and a code of 0 
means no failure. There was no output because it was directed to the log file which 
was displayed by the cat command. 


The -o option, write output to file, was used in this case. There was no output 
displayed because it was directed to the log file which was then shown by the cat 
command. The return code from wget was checked and a code of 0 means no failure. 


Notice that this time it named the downloaded file index.html .1. This is because 
index.html was created in the previous example. The author of this application did 
it this way to avoid overwriting a previously downloaded file. Very nice! 


Take a look at this next example: 


guesti@bigi:~/LinuxScriptingBook/chapters/chaps 
File Edit View Search Terminal Help 


guestl ~/LinuxScriptingBook/chapters/chap8 $ wget http://jklewis.com/shipfire.gif ~« 
--2017-06-05 14:33:31-- http://jklewis.com/shipfire.gif 

Resolving jklewis.com... 66.96.149.17 

Connecting to jklewis.com|66.96.149.17|:80... connected. 

HTTP request sent, awaiting response... 200 OK 

Length: 994 [image/gif] 

Saving to: “shipfire.gif” 


--.-K/s in Os 
2017-06-05 14:33:31 (38.8 MB/s) - “shipfire.gif” saved [994/994] 
guestl ~/LinuxScriptingBook/chapters/chap8 $ ls -la shipfire.gif 


-rw-rw-r-- 1 guestl guestl 994 Jan 29 2004 shipfire.gif 
guestl ~/LinuxScriptingBook/chapters/chap8 $ [J 











Here we are telling wget to download the file given (shipfire.gif). 
In this next screenshot we show how wget will return a useful error code: 


guesti@bigi:~/LinuxScriptingBook/chapters/chaps 
File Edit View Search Terminal Help 


guestl ~/LinuxScriptingBook/chapters/chap8 $ wget http://jklewis.com/shipfirel00O.gif ~ 
--2017-06-05 14:36:58-- http://jklewis.com/shipfirel00.gif 

Resolving jklewis.com... 66.96.149.17 

Connecting to jklewis.com|66.96.149.17|:80... connected. 

HTTP request sent, awaiting response... 404 Not Found 

2017-06-05 14:36:58 ERROR 404: Not Found. 


guestl ~/LinuxScriptingBook/chapters/chap8 $ echo $? 
8 
guestl ~/LinuxScriptingBook/chapters/chap8 $ stat shipfirel00.gif 
stat: cannot stat ‘“shipfirel00.gif': No such file or directory 
guestl ~/LinuxScriptingBook/chapters/chap8 $ 0] 
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wget return codes 


This error occurred because there is no file named shipfire100.gif in the base 
directory on my website. Notice how the output shows a 404 Not Found message, 
this is seen very often on the Web. In general, it means a requested resource was not 
available at that time. In this case the file isn't there and so that message appears. 


Note too how wget returned an 8 error code. The man page for wget shows this for 
the possible exit codes from wget: 
































Error codes Explanation 

0 No problems occurred. 

4 Generic error code. 

2 Parse error. For instance when parsing command-line 
options, the .wgetrc or .netrc files 

3 File I/O error. 

4 Network failure. 

5 SSL verification failure. 

6 Username/ password authentication failure. 

7 Protocol errors. 

8 Server issued an error response. 











A return of 8 makes pretty good sense. The server could not find the file and so 
returned a 404 error code. 


wget configuration files 


Now is a good time to mention the different wget configuration files. There are two 
main files, /etc/wgetrc is the default location of the global wget startup file. In 
most cases you probably should not edit this unless you really want to make changes 
that affect all users. The file SHOME/.wgetrc is a better place to put any options you 
would like. A good way to do this is to open both /etc/wgetrc and $HOME/.wgetre 
in your text editor and then copy the stanzas you want into your $HOME. /wgetrc file. 


For more information on the wget config files consult the man page (man wget). 
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Now let's see wget in action. I wrote this a while back to keep track of the water level 
in the lake I used to go boating in: 


Chapter 8 - Script 1 
#!/bin/sh 

# 6/5/2017 

# Chapter 8 - Script 1 


URL=http://www.arlut.utexas.edu/omg/weather. html 
FN=weather.html 


TF=templ.txt # temp file 
LF=logfile.txt # log file 
loop=1 


while [ Sloop -eq 1 ] 
do 

rm SFN 2> /dev/null # remove old file 
wget -o SLF SURL 

rc=$? 

if [ Src -ne 0 ] ; then 

echo "wget returned code: $rc" 


echo "logfile:" 


cat SLF 
exit 200 
fi 
date 


grep "Lake Travis Level:" SFN > STF 


cat STF | cut -d' ' -£ 12 --complement 


sleep 1h 


done 


exit 0 
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This output is from June 5, 2017. It's not much to look at but here it is: 


File Edit View Search Terminal 


Guesti@big1:~/LinuxscriptingBook/chapters/chaps j |} >} 


Help 


guestl ~/LinuxScriptingBook/chapters/chap8 $ scriptl 


Mon 
Mon 
Mon 
Mon 
Mon 
Mon 


Mon 


Jun 5 
Lake 
Jun 5 
Lake 
Jun 5 
Lake 
Jun 5 
Lake 
Jun 5 
Lake 
Jun 5 
Lake 
Jun 5 
Lake 


12:00:05 HST 


Travis Level: 


13:00:05 HST 


Travis Level: 


14:00:05 HST 


Travis Level: 


15:00:05 HST 


Travis Level: 


16:00:05 HST 


Travis Level: 


17:00:05 HST 


Travis Level: 


18:00:05 HST 


Travis Level: 


2017 


679. 


2017 


679. 


2017 


679. 


2017 


679. 


2017 


679. 


2017 


679. 


2017 


680. 


92 


94 


95 


99 


98 


99 


03 


feet 
feet 
feet 
feet 
feet 
feet 


feet 


guestl ~/LinuxScriptingBook/chapters/chap8 $ | | 





You can see from the script and the output that it runs once every hour. In case you 
were wondering why anyone would write something like this, I needed to know if 
the lake level went below 640 feet as I would have had to move my boat out of the 
marina. This was during a severe drought back in Texas. 


There are a few things to keep in mind when writing a script like this: 


¢ When first writing the script perform the wget once manually and then work 
with the downloaded file. 


* Do not use wget several times in a short period of time or else you may get 
blocked by the site. 


¢ Keep in mind that HTML programmers like to change things all the time and 
so you may have to adjust your script accordingly. 


¢ When you finally get the script just right be sure to activate the wget again. 


wget and recursion 


The wget program can also be used to download the contents of an entire website by 
using the recursive (-1r) option. 
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For an example look at the following screenshot: 


root@big1:/home/guesti/LinuxScriptingBook/chapters/chaps 
File Edit View Search Terminal Help 


bigl /data # wget -r -nv -o logl.txt http://lewisjk.com 
bigl /data # more logl.txt 
2017-06-05 19:02:26 URL:http://lewisjk.com/ [1560/1560] -> "lewisjk.com/index.html" [ 
1) 
2017-06-05 19:02:27 URL:http://lewisjk.com/shipfire.gif [994/994] -> "lLewisjk.com/shi 
({1] 
19:02:27 URL: http://lewisjk.com/Lewis Resume20170323.html [18572/18572] -> 

"Lewisjk.com/Lewis Resume20170323.htmL" [1] 
2017-06-05 19:02:27 URL:http://lewisjk.com/Lewis Resume20170323.doc [34304/34304] -> 
"Lewisjk.com/Lewis Resume20170323.doc" [1] 
2017-06-05 19:02:27 URL:http://lewisjk.com/spacegame/index.html [767/767] -> "lewisjk 
.com/spacegame/index. html" [1] 
2017-06-05 19:02:28 URL:http://lewisjk.com/subgame/index.html [2575/2575] -> "lewisjk 
.com/subgame/index.html" [1] 
2017-06-05 19:02:28 URL:http://lewisjk.com/lunar/betas/ [1903/1903] -> "lewisjk.com/l 
unar/betas" [1] 
2017-06-05 19:02:28 URL:http://lewisjk.com/targ/ [1836/1836] -> "lewisjk.com/targ" [1 
] 
2017-06-05 19:02:28 URL:http://lewisjk.com/tegoa/ [3028/3028] -> "lLewisjk.com/tegoa" 

({1] 
2017-06-05 19:02:28 URL:http://lewisjk.com/os2/ [6593/6593] -> "lewisjk.com/os2" [1] 
2017-06-05 19:02:29 URL:http://lewisjk.com/spacegame/opening-screen.png [96797/96797] 

-> "Lewisjk.com/spacegame/opening-screen.png" [1] 
2017-06-05 19:02:30 URL:http://lewisjk.com/spacegame/Screenshot-32.png [1036760/10367 
60] -> "“Lewisjk.com/spacegame/Screenshot-32.png" [1] 
2017-06-05 19:02:30 URL:http://lewisjk.com/spacegame/Screenshot-33.png [979374/979374 
] -> "lewisjk.com/spacegame/Screenshot-33.png" [1] 
2017-06-05 19:02:30 URL:http://lewisjk.com/spacegame/Screenshot-38.png [880885/880885 
] -> "Lewisjk.com/spacegame/Screenshot-38.png" [1] 
2017-06-05 19:02:30 URL:http://lewisjk.com/spacegame/Screenshot-40.png [897204/897204 
] -> "Lewisjk.com/spacegame/Screenshot-40.png" [1] 
2017-06-05 19:02:30 URL:http://lewisjk.com/spacegame/spacegame.html [260/260] -> "lew 
isjk.com/spacegame/spacegame.html" [1] 
2017-06-05 19:02:30 URL:http://lewisjk.com/subgame/tegoa.css [100/100] -> "lewisjk.co 
m/subgame/tegoa.css" [1] 
2017-06-05 19:02:30 URL:http://lewisjk.com/subgame/beta4/subgame.html [255/255] -> "lL 
ewisjk.com/subgame/beta4/subgame. html" [1] 
2017-06-05 19:02:31 URL:http://lewisjk.com/subgame/Screenshot-10.png [570668/570668] 

--More- - (32%) 





The no verbose (-nv) option was used to limit the output. After the wget command 
completed the more command was used to view the contents of the log. Depending 
on the number of files the output might be very long. 


When using wget you may run into unexpected issues. It may not get any files, 
or it may get some but not all of them. It might even fail without any reasonable 
error message. If this happens check the man page (man wget) very carefully. 
There may be an option that can help get you through the problem. In particular 
look at the following. 


Run wget --version on your system. It will display a detailed listing of the options 
and features and also how wget was compiled. 
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Here is an example taken from my system running CentOS 6.8 64-bit: 


guesti@big1:~/LinuxScriptingBook/chapters/chaps 
File Edit View Search Terminal Help 


guestl ~/LinuxScriptingBook/chapters/chap8 $ wget --version 
GNU Wget 1.12 built on linux-gnu. 


+digest +ipv6 +nls +ntlm +opie +md5/openssl +https -gnutls +openssl 


/etc/wgetrc (system) 

Locale: /usr/share/locale 

Compile: gcc -DHAVE CONFIG H -DSYSTEM WGETRC="/etc/wgetrc" 
-DLOCALEDIR="/usr/share/locale" -I. -I../lib -02 -g -pipe -Wall 
-Wp, -D_ FORTIFY SOURCE=2 -fexceptions -fstack-protector 
--param=ssp-buffer-size=4 -m64 -mtune=generic -fno-strict-aliasing 

Link: gcc -02 -g -pipe -Wall -Wp,-D FORTIFY SOURCE=2 -fexceptions 
-fstack-protector --param=ssp-buffer-size=4 -m64 -mtune=generic 
-fno-strict-aliasing -Wl,-z,relro -lssl -lcrypto 
/usr/1lib64/libssl.so /usr/lib64/libcrypto.so -ldl -lrt ftp-opie.o 
openssl.o http-ntlm.o gen-md5.0 ../lib/libgnu.a 


Copyright © 2009 Free Software Foundation, Inc. 

License GPLv3+: GNU GPL version 3 or later 
<http://www.gnu.org/licenses/gpl.html>. 

This is free software: you are free to change and redistribute it. 
There is NO WARRANTY, to the extent permitted by law. 


Originally written by Hrvoje Niksic <hniksic@xemacs.org>. 
Currently maintained by Micah Cowan <micah@cowan.name>. 
Please send bug reports and questions to <bug-wget@gnu.org>. 
guestl ~/LinuxScriptingBook/chapters/chap8 $ [] 





wget options 
Normally the defaults used by wget are good enough for most users, however, you 
may need to tweak things from time to time to get it to work the way you want it to. 


Here is a partial list of some of the wget options: 

















weet option Explanation 

-o filename Output messages to a log file. This was covered earlier in the 
chapter. 

-t number Try number times before giving up on the connection. 

-c Continue to download a partially downloaded file from a previous 
wget. 

-S Display the headers sent by the server. 
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wget option 


Explanation 

















-Q number The quota, or total amount of bytes that will be downloaded. 
Number can be in bytes, kilobytes (k), or megabytes (m). Set to 0 or 
inf for no quota. 

-1 number This specifies the maximum recursion level. The default is 5. 

-m This is good for when trying to create a mirror of a site. It is 


equivalent to using the -r -N -1l inf --no-remove-listing 
options. 








Another thing you may try is to turn on debugging with the -d option. Note that this 
will only work if your version of wget was compiled with debug support. Let's see 
what happens when I try it on my system: 


— 


guestl ~/LinuxSc 


Resolving jklewi 
Caching jklewis. 
Connecting to jk 
Created socket 3 


---request begin 
GET / HTTP/1.0 
Accept: */* 
Connection: Keep 
---request end-- 
HTTP request sen 
---response begi 
HTTP/1.1 200 OK 
Date: Tue, 06 Ju 
Content-Length: 


Connection: keep 
Server: Apache/2 


Expires: Wed, 07 
Age: 47 


---response end- 
200 OK 


Length: 1560 (1. 


2017-06-06 13:46 


guestl ~/LinuxSc 








guesti@big1:~/LinuxScriptingBook/chapters/chaps _|O|x 


File Edit View Search Terminal Help 


riptingBook/chapters/chap8 $ wget -d http://jklewis.com E 


DEBUG output created by Wget 1.12 on linux-gnu. 


--2017-06-06 13:46:54-- http://jklewis.com/ 


s.com... 66.96.149.17 
com => 66.96.149.17 
lewis .com|66.96.149.17|:80... connected. 


Releasing 0x00000000012d9fcO (new refcount 1). 


User-Agent: Wget/1.12 (linux-gnu) 


Host: jklewis.com 


-Alive 


t, awaiting response... 
fess 


n 2017 23:46:54 GMT 


Content-Type: text/html 


1560 
-alive 


Last-Modified: Thu, 23 Mar 2017 21:51:06 GMT 
ETag: "618-54b6cdfcO9ab1" 

Accept-Ranges: bytes 

Cache-Control: max-age=3600 


Jun 2017 00:46:07 GMT 


Registered socket 3 for persistent reuse. 


5K) [text/html] 


Saving to: “index.html” 


Sesessssesssssessas========>] 1,560 --.-K/s in Os 


:54 (174 MB/s) - “index.html” saved [1560/1560] 











riptingBook/chapters/chap8 $ 
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I wasn't sure if debugging was turned on or not, now I know. This output might not 
be very useful unless you are a developer, however, if you ever need to send in a bug 
report on wget they are going to ask for the debug output. 


As you can see, wget is a very powerful program with several options. 


va Remember to use wget with care and do not forget to put a sleep of 
<= at least a minute in your loop. An hour would be even better. 


curl 


Now let's look at the curl program as it is somewhat similar to wget. One of the 
main differences between wget and cur] is how they handle the output. 


The wget program by default displays some progress information on the screen and 
then downloads the index.html file. In contrast, curl normally displays the file 
itself on the screen. 


Here is an example of curl running on my system using my favorite website 
(screenshot shortened to save space): 











guesti@big1:~/LinuxScriptingBook/chapters/chaps 
File Edit View Search Terminal Help 
guestl ~/LinuxScriptingBook/chapters/chap8 $ curl jklewis.com 


<font size="5"> <font color="green"> 
<center>Home Page of Jim Lewis </center> 


<font size="3"> <font color="black"> 


<hl><img src="shipfire.gif" width="130" height="180" align="MIDDLE"> </h1> 


<b><p>Jim Lewis, Software Engineer</p></b> 


<hr> 
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Another way to get the output into a file is by using redirection like this: 


guesti@big1:~/LinuxScriptingBook/chapters/chaps 


File Edit View Search Terminal Help 
guestl $ curl jklewis.com > index.html 
% Total % Received % Xferd Average Speed Time Time Time Current 
Dload Upload Total Spent Left Speed 


104 1560 104 1560 0 0 4949 Q --:--i-- --:--:-- --:--:-- 10400 
guestl $[] 





You will notice that when redirected to a file the transfer progress is displayed on 
the screen. Also note that any error output goes into the file if redirected and not 
the screen. 


curl options 


Here is a very brief list of the options available in curl: 


Fo | Output filename 


Silent mode. Shows nothing, not even errors 
Show errors if in silent mode 
Verbose, useful for debugging 





There are many other options to curl, as well as several pages of return codes. For 
more information consult the curl man page. 


And now here is a script showing how curl can be used to automatically get the 
current value of the Dow Jones Industrial Average: 


Chapter 8 - Script 2 
#!/bin/sh 

# 6/6/2017 

# Chapter 8 - Script 2 


URL="https://www.google.com/finance?cid=983582" 
FN=outfilel.txt # output file 
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TF=templ1.txt 


loop=1 
while 


do 


[ Sloop -eq 1 ] 


rm SFN 2> /dev/null 
curl -o S$FN SURL 
rce=$? 


if [ Src -ne 0] ; then 


echo "curl returned code: 
echo "outfile:" 
cat SFN 
exit 200 
fi 
echo wie 
date 


# temp file for grep 


# remove old file 


# output to file 


Sre" 


# carriage return 


grep "ref 983582 1" SFN > STF 


echo -n "DJIA: " 
cat STF | cut -c 25-33 


sleep 1h 


done 


exit 0 
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Here's what it looks like on my system. Normally you would probably leave the 
progress information out of the output by using the -s option but I thought it looked 
cool and so left it in: 


guesti@big1:~/LinuxScriptingBook/chapters/chaps 


File Edit View Search Terminal Help 


guestl $ script2 
% Total % Received % Xferd Average Speed Time Time Time Current 
Dload Upload Total Spen Left Speed 
100 94006 0 94006 0 © 98740 O --:--i-- --t--'-- --1--:-- 142k 





You can see that curl and wget work pretty much the same way. Remember when 
writing scripts such as these to keep in mind that the format of the page will almost 
certainly change from time to time so plan accordingly. 


Summary 


In this chapter we showed how to use wget and curl in scripts. The default behavior 
of these programs were shown as were some of the many options. Return codes were 
also discussed and a couple of example scripts were presented. 


The following chapter will cover how to more easily debug both syntax and logic 
errors in your scripts. 
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This chapter shows how to debug Bash shell scripts. 


Programming in any language, be it C, Java, FORTRAN, COBOL, or Bash can be a 
lot of fun. However, what is often not fun is when something goes wrong, and when 
it takes an inordinate amount of time to find the problem and then solve it. This 
chapter will attempt to show the reader how to avoid some of the more common 
syntax and logic errors, and also how to find them when they occur. 


*COBOL: Okay, I have to say that programming in COBOL was never fun! 
The topics covered are in the chapter are: 


¢ How to prevent some common syntax and logic errors. 
¢ The shell debugging commands suchas set -xand set -v. 
¢ The other ways to set up debugging. 


¢ How redirection can be used to debug in real time. 


Syntax errors 


Nothing can be so frustrating than to be ona roll when coding your script or 
program and then have a syntax error pop up. In some cases the solution is so easy 
you find and solve it right away. In other cases it can take minutes or even hours. 
Here are a few pointers: 


When coding a loop put the whole while. ..do...done structure in first. It is 
sometimes really easy to forget the ending done statement, especially if the code 
spans more than a page. 
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Take a look at Script 1: 


Chapter 9 - Script 1 
#!/bin/sh 

# 

# 6/7/2017 

# 

echo "Chapter 9 - Script 1" 


x=0 
while [ $x -lt 5 ] 
do 


echo "x: $x" 


let x++ 
y=0 
while [ Sy -lt 5 ] 
do 


echo "y: Sy" 
let y++ 


done 


# more code here 


# more code here 


echo "End of script1" 


exit 0 
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And here is the output: 


Guesti@bigi-~/LinuxscriptingBook/chapters/chapo BEE 
File Edit View Search Terminal Help 


guestl ~/LinuxScriptingBook/chapters/chap9 $ scriptl 
Chapter 9 - Script 1 


./scriptl: line 26: syntax error: unexpected end of file 
guestl ~/LinuxScriptingBook/chapters/chap9 $ 





Look at this real closely, it says the error is at line 26. Wow, how can that be, when 
the file has only has 25 lines in it? The simple answer is that's just the way the Bash 
interpreter handles this type of situation. If you have not already found the bug 

it's actually at line 12. This is where the done statement should have been and by 
omitting it I intentionally caused the error. Now imagine if this had been a really 
long script. Depending on the circumstances it could take a long time to find the line 
that caused the problem. 


Now take a look at Script 2, which is just Script 1 with some additional echo statements: 


Chapter 9 - Script 2 
#!/bin/sh 

# 

# 6/7/2017 

# 

echo "Chapter 9 - Script 2" 


echo "Start of x loop" 
x=0 

while [ $x -1lt 5 ] 

do 

echo "x: Sx" 


let x++ 


echo "Start of y loop" 
y=0 
while [ $y -1t 5 ] 
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do 
echo "y: sy" 
let y++ 


done 


# more code here 


# more code here 


echo "End of script2" 


exit 0 


Here is the output: 





guesti@bigi:~/LinuxScriptingBook/chapters/chap9 
File Edit View Search Terminal Help 


guestl ~/LinuxScriptingBook/chapters/chap9 $ script2 
Chapter 9 - Script 2 


Start of x loop 
./script2: line 28: syntax error: unexpected end of file 
guestl ~/LinuxScriptingBook/chapters/chap9 $ a 





You can see that the echo statement Start of x loop was displayed. However, the 
second one, Start of y loop was not displayed. This gives you a good idea that 
the error is somewhere before the 2nd echo statement. In this case it is right before, 
but don't expect to be that lucky every time. 


Automatic backups 


Now for a bit of free programming advice, making automatic backups of files was 
mentioned in Chapter 4, Creating and Calling Subroutines. I strongly suggest you use 
something like this when you are writing anything that is even slightly complicated. 
There is nothing more frustrating than to be working on your program or script and 
have it going pretty well, only to make a few changes and have it fail in some bizarre 
fashion. You had it working a few minutes ago and then wham! It has a fault and 
you can't figure out what change caused it. If you don't have a numbered backup 
you could literally spend hours (maybe days) trying to find the bug. I have seen 
people spend hours backing out every change until the problem was found. Yes, I 
have done it too. 
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Obviously if you have a numbered backup you can simply go back and find 

the latest one that doesn't have the fault. You can then diff the two versions and 
probably find the error really fast. Without a numbered backup, well you are on your 
own. Don't do what I did and wait 2 years or more before realizing all of this. 


More syntax errors 


A fundamental problem with shell scripts is syntax errors don't usually show up 
until the line with the problem is parsed by the interpreter. Here's a common error 
that I still find myself doing more than I should. See if you can locate the problem by 
just reading the script: 


Chapter 9 - Script 3 
#!/bin/sh 

# 

# 6/7/2017 

# 

echo "Chapter 9 - Script 3" 


if [| S# -ne 1] ; then 


echo "Usage: script3 parameter" 


exit 255 
fi 
parm=$1 


echo "parm: $parm" 


if [ "Sparm" = "home" ] ; then 
echo "parm is home." 

elif if [ "Sparm" = "cls" ] ; then 
echo "parm is cls." 

elif [ "Sparm" = "end" ] ; then 


echo "parm is end." 
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else 
echo "Unknown parameter: $parm" 


fi 


echo "End of script3" 


exit 0 


Here's the output: 














guesti@bigi:~/LinuxScriptingBook/chapters/chap9 
File Edit View Search Terminal Help 


guestl ~/LinuxScriptingBook/chapters/chap9 $ script3 
Chapter 9 - Script 3 

Usage: script3 parameter 

guestl ~/LinuxScriptingBook/chapters/chap9 $ script3 home 
Chapter 9 - Script 3 

parm: home 

./script3: line 28: syntax error: unexpected end of file 
guestl ~/LinuxScriptingBook/chapters/chap9 $ script3 cls 
Chapter 9 - Script 3 

parm: cls 

./script3: line 28: syntax error: unexpected end of file 
guestl ~/LinuxScriptingBook/chapters/chap9 $ script3 end 
Chapter 9 - Script 3 

parm: end 

./script3: line 28: syntax error: unexpected end of file 
guestl ~/LinuxScriptingBook/chapters/chap9 $ script3 noparm 
Chapter 9 - Script 3 

parm: noparm 

./script3: line 28: syntax error: unexpected end of file 
guestl ~/LinuxScriptingBook/chapters/chap9 $ [] 





Did you find my mistake? When I code an if...elif...else statement, I tend to 
copy and paste the first if statement. I then prepend e1if to the next statement but 
forget to remove the if. This gets me almost every time. 


Look at how I ran this script. I started first with just the name of the script to invoke 
the Usage clause. You may find it interesting that the syntax error was not reported 
by the interpreter. That's because it never got down to that line. This can be a real 
problem with scripts, as it may run for days, weeks, or even years before running 

a part of code that has a syntax error in it and then failing. Keep this in mind when 
writing and testing your scripts. 
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Here is another quick example of a classic syntax error (classic in the sense that I just 
now made it again): 


for i in *.txt 
echo "i: Si" 


done 


When run it outputs this: 


./script-bad: line 8: syntax error near unexpected token ~echo' 


. 


./script-bad: line 8: echo "i: $i"! 


Can you find my mistake? If not look again. I forgot the do statement after the for 
statement. Bad Jim! 


One of the easiest things to do wrong ina script is to forget the $ in front of a 
variable. This is particularly so if you code in other languages such as C or Java, 
because you don't prepend a $ to variables in those languages. The only real advice 
I can give here is if your script just doesn't seem to be doing anything right check all 
of your variables for the $. But be careful you don't go too far and start adding them 
where they don't belong! 


Logic errors 


Now let's talk about logic errors. These can be very hard to diagnose, and 
unfortunately I don't have any magical ways to avoid those. There are some things 
that can be pointed out however to help track them down. 


A common problem with coding is what is called off by 1 errors. This was caused 
when computer language designers in the sixties decided to number things starting 
at 0 instead of 1. Computers will happily start counting anywhere you want them 
to and never complain at all, but most humans tend to do better when they start 
counting at 1. Most of my peers would probably disagree with this, but since I was 
the one who always had to fix their off by 1 defects I stand by my comments. 


Let's look at the following very simple script: 


Chapter 9 - Script 4 
Sarees 

# 6/7/2017 

# 
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echo "Chapter 9 - Script 4" 


x=0 
while [ $x -lt 5 ] 
do 

echo "x: $x" 

let x++ 


done 


echo "x after loop: $x" 


let maxx=x 


y=1 
while [ Sy -le 5 ] 
do 

echo "y: sy" 

let y++ 


done 


echo "y after loop: $y" 


let maxy=y-1 # must subtract 1 


echo "Max. number of x: Smaxx" 


echo "Max. number of y: $maxy" 


echo "End of script4" 


exit 0 
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And the output: 





guesti@bigi:~/LinuxScriptingBook/chapters/chap9 
File Edit View Search Terminal Help 


guestl ~/LinuxScriptingBook/chapters/chap9 $ script4 
Chapter 9 - Script 4 
x: 0 


“after loop: 5 


x 
x 
x 
x 
x 
y 
y: 
y 
y 
y 


5 

y after loop: 6 

Max. number of x: 5 

Max. number of y: 5 

End of script4 

guestl ~/LinuxScriptingBook/chapters/chap9 $ [ 





Look at the subtle differences between the two loops: 


In the x loop the counting was started at 0. 

x was incremented while it was less than 5. 

The value of x after the loop was 5. 

The var maxx, which is supposed to equal the number of iterations, is set to x. 
In the y loop the counting was started at 1. 

y was incremented while it was less than or equal to 5. 

The value of y after the loop was 6. 


The var maxy, which is supposed to equal the number of iterations, 
is set to y-1. 


If you already understand the above perfectly you will probably never have a 
problem with 1 off errors and that's great. 


For the rest of us I suggest looking over this very carefully until you get it just right. 
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Using set to debug scripts 


You can use the set commands to help with debugging your scripts. There are two 
common options to set, x and v. Here is a description of each. 


Note that a - activates the set while a + deactivates it. If that sounds backwards to 
you it is because it is backwards. 


Use: 


* set -x: to display the expanded trace before running the command 


* set -v: to display the input line as it is parsed 


Take a look at Script 5 which shows what set -x does: 


Chapter 9 - Script 5 and Script 6 
aaa 

# 6/7/2017 

# 


set -x # turn debugging on 
echo "Chapter 9 - Script 5" 


x=0 
while [ $x -lt 5 ] 
do 

echo "x: $x" 

let x++ 


done 


echo "End of script5" 


exit 0 
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And the 


Ch 
+ 


ae 
se 
x 
+ 
+ 
of 
x 
+ 
of 
+ 
xt 
+ 
+ 
+ 
x 
+ 
+ 
+ 
x 
+ 
+ 


+ 
En 
oe 





output: 


File Edit View Search Terminal 


guesti@bigi:~/LinuxScriptingBook/chapters/chap9 


Help 


apter 9 - Script 5 


x=0 
'[! 
echo 


0 -1t 5 
'x: 0' 


: 0 


let x++ 
"C" L=-tt 5 
echo 'x: 1' 


el 


let x++ 

‘CT 2 =Ut'5 

echo 'x: 2' 
2 

let x++ 

‘E' 3 -tt-5 

echo 'x: 3' 


73 


let x++ 
‘T' 4 -1t 5 
echo 'x: 4' 


: 4 


let x++ 
'T' 5 -1t 5 


y! 


y! 


y! 


y) 


a 


y! 


echo ‘End of script5' 


d of script5 
exit 0 





guestl ~/LinuxScriptingBook/chapters/chap9 $ script5 
+ echo ‘Chapter 9 - Script 5' 


guestl ~/LinuxScriptingBook/chapters/chap9 $ [ 


If this looks a little strange at first don't worry, it gets easier the more you look at it. 
In essence, the lines that start with a + are the expanded source code lines, and the 
lines without a + are the output of the script. 


Look at the first two lines. It shows: 


+ echo 'Chapter 9 - Script 5! 


Chapter 9 - Script 5 


The first line shows the expanded command and the second the output. 
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You can also use the set -v option. Here is a screenshot of Script 6 which is just 
Script 5 but with set -v this time: 


guesti@bigi:~/LinuxScriptingBook/chapters/chap9 
File Edit View Search Terminal Help 
guestl ~/LinuxScriptingBook/chapters/chap9 $ script6 


echo "Chapter 9 - Script 6" 
Chapter 9 - Script 6 


x=0 


echo "x: $x" 
let x++ 
done 
xX! 


echo "End of script6" 

End of script6 

exit 0 

guestl ~/LinuxScriptingBook/chapters/chap9 $ (] 





You can see the output is quite a bit different. 


Note that with the set commands you can turn them on and off at any point you 
want in the script. This is so you can limit the output to just the areas of the code you 
are interested in. 


Let's look at an example of this: 


Chapter 9 - Script 7 

#!/bin/sh 

# 

# 6/8/2017 

# 

set +X # turn debugging off 


echo "Chapter 9 - Script 7" 
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x=0 

for fn in *.txt 

do 
echo "x: Sx - fn: S$fn" 
array [$x] ="$fn" 
let x++ 


done 


maxx=Sx 


echo "Number of files: Smaxx" 


set -x # turn debugging on 


x=0 

while [ Sx -lt Smaxx ] 

do 
echo "File: ${array[$x] }" 
let x++ 


done 


set +x # turn debugging off 


echo "End of script7" 


exit 0 
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And the output: 


Guesti@bigi:~/LinuxscriptingBook/chapters/chap9 | |) ><} 
File Edit View Search Terminal Help 


guestl ~/LinuxScriptingBook/chapters/chap9 $ script7 
Chapter 9 - Script 7 
: bak-0001.chapter9.txt 
: bak-0002.chapter9.txt 
: chapter9.txt 
x: 3 - fn: chapter-template. txt 
Number of files: 4 
+ x=0 
+ '[' 0 -1t 4 ']' 
+ echo ‘File: bak-0001.chapter9.txt' 
File: bak-0001.chapter9.txt 
+ Let xX++ 
1 -1t 4 ']' 
"File: bak-0002.chapter9.txt' 
: bak-0002.chapter9.txt 
+ let x++ 
2 -1t 4 'J' 
"File: chapter9.txt' 
: chapter9.txt 


‘File: chapter-template.txt' 
: chapter-template.txt 


End of script7 
guestl ~/LinuxScriptingBook/chapters/chap9 $ (] 








Notice how the debugging was explicitly turned off at the beginning of the script 
even though it is off by default. This is a good way to keep track of when it is off and 
when it is on. Look at the output closely and see how the debug statements don't 
start displaying until the second loop with the array. Then it is turned off before 
running the last two lines. 


The output when using the set commands can be pretty hard to look at sometimes 
and so this is a good way to limit what you have to wade through to get to the lines 
of interest. 


There is another debugging technique that I use quite frequently. In many cases I 
think it is superior to using the set commands as the display does not get quite as 
cluttered. You may recall in Chapter 6, Automating Tasks with Scripts, that we were 
able to display output to other terminals. This is a very handy feature. 
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The following script shows how to display output in another terminal. A subroutine 
is used for convenience: 


Chapter 9 - Script 8 

#!/bin/sh 

# 

# 6/8/2017 

# 

echo "Chapter 9 - Script 8" 

TTY=/dev/pts/35 # TTY of other terminal 


# Subroutines 


pl() # display to TTY 
{ 
rce1=0 # default is no error 
if [ S# -ne 1] ; then 
rcel=2 # missing parameter 
else 


echo "$1" > STTY 
rcel=$? # set error status of echo command 


fi 


return $rcl 


# Code 


pl # missing parameter 


echo $? 


pl Hello 


echo $? 


pl "Linux Rules!" 
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echo $? 


pl "Programming is fun!" 


echo $? 


echo "End of scripts" 


exit 0 


And the output: 





guesti@big1:~/LinuxScriptingBook/chapters/chap9 


File Edit View Search Terminal Help 


guestl ~/LinuxScriptingBook/chapters/chap9 $ script8 
Chapter 9 - Script 8 
2 


End of scripts 
guestl ~/LinuxScriptingBook/chapters/chap9 $ [| 








Remember to quote the parameter to p1 in case it contains blank characters. 


This subroutine might be a bit of overkill to use for debugging but it captures many 
of the concepts previously discussed in this book. This approach can also be used 
in a script to display information in multiple terminals. We will go over that in the 
next chapter. 


Q When writing to a terminal if you get a message similar to this: 


./script8: line 26: /dev/pts/99: Permission denied 


It probably means the terminal has not been opened yet. Also remember to put your 
terminal device strings into a variable because those tend to change after a reboot. 
Something like TTy=/dev/pts/35 is a good idea. 


A great time to use this debugging technique is when writing a form script as we did 
in Chapter 5, Creating Interactive Scripts. So, let's take a look at that script again and 
put this new subroutine to use. 
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Chapter 9 - Script 9 


#!/bin/sh 
# 6/8/2017 


# Chapter 9 - Script 9 


# 
TTY=/dev/pts/35 


# Subroutines 


cls () 


{ 


tput clear 


} 


move () 


{ 


tput cup $1 $2 


} 


movestr () 


{ 
tput cup $1 $2 


echo -n "$3" 


} 


checktermsi ze () 


{ 


# debug terminal 


# move cursor to row, col 


# move cursor to row, col 


# display string 


pl "Entering routine checktermsize." 


rc1=0 # default is no error 
if [[ SLINES -1t $1 || SCOLUMNS -1t $2 ]] ; then 
rel=1 # set return code 

fi 


return $recl 
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init () 


{ 


pl "Entering routine init." 











srow[0]=2; scol[0]=7 
srow[1]=4; scol[1]=12 
srow[2]=6; scol[2]=12 
srow[3]=8; scol[3]=7 
srow[4]=8; scol [4] =37 
srow[5]=8; scol[5]=52 
srow[6]=10; scol[6]=8 


drawscreen () 


{ 


# set up the cursor position array 


name 
address 1 
address 2 
city 
state 


zip code 


+ + + HH H+ H +H 


email 


# main screen draw routine 


pl "Entering routine drawscreen." 


# clear the screen 


cls 

movestr 0 25 "Chapter 9 - Script 9" 
movestr 2 1 "Name:" 
movestr 4 1 "Address 1:" 
movestr 6 1 "Address 2:" 
movestr 8 1 "City:" 
movestr 8 30 "State:" 
movestr 8 42 "Zip code:" 
movestr 10 1 "Email:" 

} 
getdata () 


: 


pl "Entering 


x=0 
Pol=0 
while 


do 


[ $rcl -eq 0 ] 


routine getdata." 


# array subscript 


# loop control variable 
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row=${srow[x]}; col=${scol [x] } 


pl "row: $row col: $col" 


move Srow S$col 
read array [x] 
let x++ 
if [ $x -eq $sizeofarray ] ; then 
rel=1 
rea 
done 


return 0 


} 


showdata () 


{ 


pl "Entering routine showdata." 


fn=0 

echo mu 

read -p "Enter filename, or just Enter to skip: " filename 
if [ -n "$filename" ] ; then # if not blank 


echo "Writing to '$filename'" 


fn=1 # a filename was given 
fi 
echo "" # skip 1 line 


echo "Data array contents: " 
y=0 
while [ Sy -lt $sizeofarray ] 
do 
echo "$y - ${array[$y] }" 
if [ $fn -eq 1] ; then 
echo "Sy - ${array[$y]}" >> "$filename" 
fi 
let y++ 


done 
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return 0 
} 
pl() # display to TTY 
{ 
rce1=0 # default is no error 
if [ S# -ne 1] ; then 
rcl=2 # missing parameter 
else 


echo "$1" > STTY 
rcel=$? # set error status of echo command 


fi 


return $rcl 


# Code starts here 


pr" # carriage return 


pl "Starting debug of script9" 


sizeofarray=7 # number of array elements 


if [ "sl" = "=-help" ] 7; “then 


pl "In Usage clause." 


echo "Usage: script9 --help" 

echo " This script shows how to create an interactive screen program" 
echo " and how to use another terminal for debugging." 

exit 255 

fi 


checktermsize 25 80 
rc=$? 


if [ Src -ne 0 ] ; then 
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echo "Please size the terminal to 25x80 and try again." 


exit 1 


fi 


init 
drawscreen 
getdata 


showdata 


pl "At exit." 


exit 0 


# initialize the screen array 
# draw the screen 
# cursor movement and data input routine 


# display the data 


Here is the output from the debug terminal (dev/pts/35): 











/dev/pts/35 


At exit. 





7 
12 
12 
7 
37 
52 


guesti@bigi:~/LinuxScriptingBook/chapters/chap9 


File Edit View Search Terminal Help 
guestl ~/LinuxScriptingBook/chapters/chap9 $ tty 


guestl ~/LinuxScriptingBook/chapters/chap9 $ 
debug of script9 

routine 

routine 

routine 

routine 

col: 

col: 

col: 

col: 

col: 

col: 

10 col: 8 

Entering routine 


checktermsize. 
init. 
drawscreen. 
getdata. 


showdata. 





By having the debug information display in another terminal it is much easier to see 
what is happening in the code. 


You can put the p1 routine where ever you think the problem might be. Labeling 
which subroutine is being used can also help locate if the problem is in a subroutine 
or in the main code body. 


When your script is completed and ready for use, you don't have to remove the calls 
to the p1 routine unless you really want to. You can just code a return 0 at the top 


of the routine. 
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I use this approach when debugging shell scripts or C programs and it has always 
worked very well for me. 


Summary 


In this chapter we explained how to prevent some common syntax and logic errors. 
The shell debugging commands set -xand set -v were also described. Using 
redirection to send the output from a script to another terminal was also shown as a 
way to debug in real time. 


In the next chapter we will talk about scripting best practices. This includes making 
careful backups of your work and selecting a good text editor. A way to help you be 
more productive using the command line by using environment variables and aliases 
will also be discussed. 
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scripting Best Practices 


This chapter explains some practices and techniques that will help the reader become 
a better and more efficient programmer. 


In this chapter we will talk about what I consider to be scripting (or programming) 
best practices. Having programmed computers since 1977 I have attained quite a bit 
of experience in this field. I take great pleasure in teaching people about computers 
and hopefully my ideas will be of some benefit. 


The topics covered are as follows: 


¢ Backups will be discussed again, including verification 

¢ I'll explain how to pick a text editor you are comfortable with and learn its 
capabilities 

¢ I'll cover some basic command line items such as using a good prompt, 
command completion, environment variables and aliases 


¢ I'll provide some bonus scripts 


Verifying backups 

I have already spoken about backups at least twice in this book and this will be 

the last time I promise. Create your backup scripts and make sure they run when 
they are supposed to. But one thing I have not talked about yet is verification of the 
backups. You might have 10 teraquads of backups lying around somewhere, but do 
they actually work? When was the last time you checked? 


When using the tar command it will report at the end of the run if it encountered 
any issues making the archive. In general if it doesn't show anything amiss the 
backup is probably good. Using tar with the -t (te11) option, or actually 
extracting it on the local or remote machine, is also a good way to determine if the 
archive was made successfully. 
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& * Note: A somewhat common mistake when using tar is to include a 
file in the backup that is currently being updated. 


Here is a rather obvious example: 


guestl /home # tar cvzf guestl.gz guest1/ | tee /home/guest1/temp/ 
mainlogs*~date '+%Y%m%d'~.gz 

The tar command might not consider this an error but will usually report it so be 
sure to check for this. 


Another common backup mistake is to not copy the file to another computer or 
external device. If you are good at making backups but they are all on the same 
machine eventually the hard drive and/or controller is going to fail. You may be 
able to recover the data but why take the risk? Copy your files to at least one external 
drive and/or computer and be safe. 


There is one last thing about backups I will mention. Make sure you have a backup 
sent to an off-site location, preferably in another city, state, continent, or planet. You 
really can't be too careful with your valuable data. 


ssh and scp 


Using scp to a remote computer is a really good idea too and my backup program 
does that every night as well. Here is how to set up unattended ssh/ scp. In this case, 
the root account on machine 1 (M1) will be able to scp files to the guest 1 account on 
machine 2 (M2). I do it this way because I always disable root access of ssh/ scp for 
security reasons on all my machines. 


1. First make sure ssh has been run at least once on each machine. This will set 
up some needed directories and files. 


2. OnM1, under root, run the ssh-keygen -t rsa command. This will create 
the file id_rsa.pub in the /root/.ssh directory. 


3. Use scp to copy that file to M2 to the /tmp directory (or some other suitable 
location). 


On M2 go to the /home/guest1/.ssh directory. 
If there is already an authorized_keys file edit it, otherwise create it. 


Copy the line in the /tmp/id_rsa. pub file into the authorized_keys file 
and save it. 
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Test this by using scp to copy a file from M1 to M2. It should work without 
prompting for a password. If there are any problems remember that this has to be set 
up for each user that wants to perform unattended ssh/scp. 


If you have an Internet service provider (ISP) that provides SSH with your account 
this method should work on there as well. I use it all the time and it is really 
convenient. Using this approach you can have a script generate an HTML file and 
then copy it right to your website. Dynamic generation of HTML pages is something 
programs are really good at. 


Find and use a good text editor 


If you only occasionally write scripts or programs then vi is probably good 

enough for you. However, if you get into some real in depth programming, be it in 

Bash, C, Java, or some other language you should very definitely check out some of 
the other text editors that are available on Linux. You will almost certainly become 

more productive. 


As I mentioned before, I have been working with computers for a really long time. 
I started out using an editor on DOS called Edlin and it was pretty weak (but 

still better than punch cards). I eventually moved on and started using vi on AIX 
(IBM's version of UNIX). I got pretty good at using vi since we didn't have any 
other options yet. As time went on other choices became available and I started 
using the IBM Personal Editors. These were really easy to use, more efficient than 
vi, and had many more features. As I did more and more programming, I found 
that none of these editors could do everything I wanted and so I wrote my own in 
the C programming language. This was a long time ago under DOS, however, my 
editor has now been modified to run on Xenix, OS/2, AIX, Solaris, UNIX, FreeBSD, 
NetBSD, and of course Linux. It also works well on Windows under the Cygwin 
environment. 


Any text editor should have the standard features such as copy, paste, move, insert, 
delete, split, join, find/replace, and so on. These should be easy to use and require 
not more than two keystrokes. The save command should only need one keystroke. 


In addition, a good editor will also have one, more, or all of the following: 


¢ Ability to edit more than one file at a time (file ring) 
¢ Ability to switch to the next or previous file in the ring with a single keystroke 
* Be able to show which files are in the ring and switch to any file instantly 


¢ Ability to insert a file into the current file 
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* Be able to record and play back a remembered key sequence. This is 
sometimes referred to as a macro 


¢ Anundo/restore feature 
¢ Anauto file save option 


* A locked files feature, to prevent editing the same file in another instance of 
the editor 


¢ Absolutely no obvious shortcomings or bugs. This is mandatory 


¢ Accept input via telepathy 


Well, maybe I haven't quite figured out that last one yet. There are of course 
many, many more features that could be listed but I feel those are some of the 
most important. 


Here's a screenshot of my editor showing an example of how the ring command 
might look: 


guesti@big1:~/LinuxScriptingBook/chapters/chap10 
File Edit View Search Terminal Help 


---- Top of file ---- 
Chapter 1 - Getting started with shell scripting 
Files in Ring 

/home/guest1/LinuxScriptingBook/chapters/chapl/chapterl. 
/home/guest1/LinuxScriptingBook/chapters/chap2/chapter2. 
/home/guest1/LinuxScriptingBook/chapters/chap3/chapter3. 
/home/guest1/LinuxScriptingBook/chapters/chap4/chapter4. 
/home/guest1/LinuxScriptingBook/chapters/chap5/chapter5. 
/home/guest1/LinuxScriptingBook/chapters/chap6/chapter6. 
/home/guest1/LinuxScriptingBook/chapters/chap7/chapter7. 
/home/guest1/LinuxScriptingBook/chapters/chap8/chapters. 
/home/guest1/LinuxScriptingBook/chapters/chap9/chapter9. 


1 
2 
3 
4 
5 
6 
7 
8 
9 


Enter # to select: [] 


Show how to validate parameters by using conditional statements. 


Explain how to determine the attributes of files. 


Here is an example of a very simple script. It might not look like much 
but this is the basis for every script: 


Chapter 1 - Script 1 


Sat Jun 10 10:12am === 
1 Col 1 NEW 340 





Lewis Linux Editor 5/5/2017 chapl/chapter1.txt 
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Many more features could be shown but that should be enough to get the point 
across. I will mention that vi is a fine editor and is used with success by probably the 
majority of UNIX/Linux people. However, in my experience if a lot of programming 
is being done the use of a different editor with more features will save you a lot of 
time. It's also quite a bit easier, and that makes the process even more fun. 


Environment variables and aliases 


Environment variables were covered in Chapter2, Working with Variables. Here is 

a cool trick that I learned years ago that can really help when using the command 
line. Most Linux systems generally have several standard directories under $HOME 
such as Desktop, Downloads, Music, Pictures, and so on. I personally do not like 
typing the same things over and over again and so do this to help use the system 
more efficiently. Here are some of the lines that I have added to my /home/guest1/. 
bashre file: 

export BIN=SHOME/bin 

alias bin="cd SBIN" 


export DOWN=SHOME/Downloads 
alias down="cd SDOWN" 


export DESK=SHOME/Desktop 
alias desk="cd SDESK" 


export MUSIC=S$HOME/Music 
alias music="cd SMUSIC" 


export PICTURES=SHOME/Pictures 
alias pictures="cd $PICTURES" 


export BOOKMARKS=SHOME/Bookmarks 
alias bookmarks="cd SBOOKMARKS" 


# Packt- Linux Scripting Bootcamp 


export LB=SHOME/LinuxScriptingBook 
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alias lb="cd SLB" 


# Source lbcur 


SLB/source.lbcur.txt 


Using this approach you can cd to any of the above directories by just typing the 
lowercase alias. What's even better is you can also copy or move files to or from the 
directory by using the uppercase exported environment variable. Check out the 
following screenshot: 


guesti@bigi:~/LinuxScriptingBook/chapters/chap10 
File Edit View Search Terminal Help 


guestl ~ $ down 
guestl ~/Downloads $ la 
total 14412 
2 guestl guestl 4096 Jun ; : 
. 46 guestl guestl 4096 Jun 17... 
1 guestl guestl 3176586 Jun :23 CaliforniaSun.mp3 
-rw-r--r-- 1 guestl guest1l 10505138 Jun :23 LINUX UTILITIES COOKBOOK. pdf 
-rw-r--r-- 1 guestl guestl 293500 Jun :23 starship. jpg 
-rwW-rw-r-- 1 guestl guestl 768609 Jun :23 utilityl.docx 
guestl ~/Downloads $ music 
~/Music $ mv $DOWN/CaliforniaSun.mp3 . 
~/Music $ pictures 
~/Pictures $ mv $DOWN/starship.jpg . 
~/Pictures $ bookmarks 
~/Bookmarks $ mv /home/guest1/Desktop/bookmarks-2017-06-10.json . 
~/Bookmarks $ lb 
~/LinuxScriptingBook $ cat source.lLbcur.txt 


# Source this file from .bashrc 
export LBCUR=$LB/chapters/chap10 
alias lbcur="cd $LBCUR" 


guestl ~/LinuxScriptingBook $ lbcur 
guestl ~/LinuxScriptingBook/chapters/chapl0 $ [] 





It took me several years to start doing this and I am still kicking myself for not 
discovering it sooner. Remember to make the alias lowercase and the env var 
uppercase and you should be good to go. 


Notice the command I ran in the Bookmarks directory. I actually typed mv $DESK/ 
and then hit the Tab key. This caused the line to auto-complete and then I added the 
dot . character and pressed Enter. 


Remember to use command auto-completion any time you can, it's a great time saver. 
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The line . $LB/source.1bcur.txt needs to be explained. You can see I have an 
lbcur alias which puts me into the directory where I am currently working on this 
book. Since I use both my root and guest1 accounts to write a book, I can change the 
chapter number in just the source. 1lbcur.txt file. I then source the .bashrc files 
for root and guest1 and I'm done. Otherwise, I would have to make the change in 
each .bashrc file. With just two files maybe it wouldn't be that bad, but suppose 
you had several users? I use this technique quite a bit on my systems as I am a very 


lazy typist. 


Remember: When using aliases and environment variables you need to source the 
users's .bashrc file before any changes will be picked up in the terminal. 


ssh prompt 

When I run a Linux system I tend to have at least 30 terminal windows open. Some 
of these are logged into the other machines in my house. As of this writing I am 
logged into laptop1, laptop4, and gabil (my girlfriend's laptop running Fedora 20). I 
found a while back that if the prompt were different on these terminals it was harder 
for me to get mixed up and type the right command but on the wrong computer. 
Needless to say that could be a disaster. For a while I would change the prompt 
manually but that got old very quickly. One day I found almost by accident a really 
cool solution to this problem. I have used this technique on Red Hat Enterprise 
Linux, Fedora, and CentOS and so it should work on your system as well (with 
maybe a little bit of tweaking). 


These lines are in the $HOME/. bashrc file on all my systems: 


# Modified 1/17/2014 
set | grep XAUTHORITY 
rc=$? 

if [ $rc -eq 0 ] ; then 
PS1="\h \w # " 

else 

PS1="\h \h \h \h \w # " 
fi 


So what this does is use the set command to grep for the string XAUTHORITY. That 
string is only in the environment on the local machine. So when you open a terminal 
locally on big1 it uses the normal prompt. However, if you ssh to another system the 
string is not there and so it uses the long expanded prompt. 
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Here is a screenshot of my system showing how this looks: 














Testing an archive 


Here is something that I ran into on several of my computer jobs. I would be asked 
by my manager to take over a project from a fellow worker. He would zip or tar up 
the files and then give me the archive. I would uncompress it on my system and try 
to begin the work. But there was always a file missing. It would often take two, three, 
or more attempts before I would finally have every file needed to compile the project. 
So, the moral to this story is when making an archive to give to someone else make 
absolutely sure to copy it to another machine and test it there. Only then can you be 
reasonably sure that you have included every file. 


Progress indicator 


Here is another cursor movement script that also calculates the low and high of the 
$RANDOM Bash variable. It might not look all that cool to everyone but it does show 
some more of the concepts we have covered in this book. I was also somewhat 
curious as to what the range of that random number generator was. 


Chapter 10 - Script 1 
#!/bin/sh 

# 

# 6/11/2017 

# Chapter 10 - Script 1 

# 


# Subroutines 
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trap catchCtrlc INT # Initialize the trap 


# Subroutines 


catchCtr1c() 


{ 


loop=0 # end the loop 


} 


cls () 


{ 


tput clear 


} 


movestr () # move cursor to row, col, 


{ 
tput cup $1 $2 


echo -n "$3" 


} 
# Code 
if [ "$1" = "--help" ] ; then 


echo "Usage: scriptl or script1 --help " 


display string 


echo " Shows the low and high count of the Bash RANDOM variable." 


echo " Press Ctrl-C to end." 


exit 255 
fi 
sym[0]='|' 
sym[1]='/' 
sym[2]='-' 
sym[3]='\' 


low=99999999 
high=-1 


cls 
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echo "Chapter 10 - Script 1" 

echo "Calculating RANDOM low and high ..." 

loop=1 

count=0 

x=0 

while [ Sloop -eq 1 ] 

do 

r=SRANDOM 

if [ Sr -lt Slow ] ; then 
low=$r 

elif [ $r -gt S$high ] ; then 
high=Sr 

fi 


# Activity indicator 
movestr 2 1 "${sym[x] }" # row 2 col 1 
let x++ 
if [ $x -gt 3 ] ; then 
x=0 


fi 


let count++ 


done 


echo " " # carriage return 
echo "Number of loops: $count" 


echo "low: Slow high: $high" 


echo "End of script1" 


exit 0 
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And the output on my system: 


guesti@bigi:~/LinuxScriptingBook/chapters/chap10 
File Edit View Search Terminal Help 


Chapter 10 - Script 1 

Calculating RANDOM low and high ... 
|*C/ 

Number of loops: 185994 

low: 0 high: 32767 


End of scriptl 
guestl ~/LinuxScriptingBook/chapters/chapl0 $ [] 








Creating new commands from a template 


Since you are reading this book it can be assumed that you are going to be writing 
a good number of scripts. Here is another handy trick I learned over the years. 
When I need to create a new script, instead of doing it from scratch I use this 
simple command: 


Chapter 10 — Script 2 
ones 

# 1/26/2014 

# 


# create a command script 


if [ $# -eq 0 ] ; then 

echo "Usage: mkcmd command" 

echo " Copies mkcmd.template to command and edits it with kw" 
exit 255 

fi 


if [ -£ $1 ] ; then 


echo File already exists! 
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exit 2 


fa: 


cp SBIN/mkcmd.template $1 
kw $1 


exit 0 


And here is the contents of the $BIN/mkcmd.template file: 
#!/bin/sh 
# 
# Date 
# 
if [ $# -eq 0 ] ; then 
echo "Usage: ” 
echo " w 
exit 255 
fi 
Be sure that after you create the mkcmd. template file that you run chmod 755 on it. 


That way you do not have to remember to do it every time on your new commands. 
In fact, that was the main reason I wrote this script. 


Feel free to modify this however you want, and of course change kw to vi or 
whatever editor you are using. 


Alerting the user 


It's nice to have your computer beep when an important task has completed and you 
want to know about it right away. Here's a script I use to beep the internal speaker 
on my computer: 


Chapter 10 — Script 3 
#!/bin/sh 

# 

# 5/3/2017 

# 








[ 184] 


Chapter 10 





# beep the PC speaker 


lsmod | grep pespkr > /dev/null 

rc=$? 

if [ Src -ne 0 ] ; then 

echo "Please modprobe pcspkr and try again." 
exit 255 

fi: 


echo -e '\a!' > /dev/console 


This command will beep the PC speaker if it has one and if the driver has been 
loaded. Note that this command will probably only work on your system when 
run as the root user. 


Summary 


In this last chapter, I showed some of the programming best practices I have learned. 
The features of a good text editor were talked about, and a $RANDOM testing script 
was included. I also presented some of the scripts I have written over the years to 
make my systems more efficient and easier to use. 
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